IT in Industry

The Role of IT in Research and Development: A Tutorial on Innovation and Collaboration

The tools lab and product teams use to share data, track versions and work together, with notes on data management, security and intellectual property.

On this page
  1. What R&D teams need from IT
  2. Sharing and storing data
  3. Tracking work and versions
  4. Reproducibility
  5. Collaboration tools
  6. Computing power
  7. Protecting ideas and data
  8. Managing the balance

What R&D teams need from IT

Research and development covers a wide range: laboratory science, software prototypes, engineering design, product testing and market research. Despite the variety, the teams share some needs. They produce a lot of data and documents, they build on each other’s work, they often collaborate across sites or organizations, and they need to be able to show later what was done and how.

IT supports this by providing places to store and share work, tools to track changes, enough computing power for analysis, and security around valuable ideas. Because the work is exploratory, flexibility matters. Overly rigid systems tend to be bypassed.

Sharing and storing data

Experiments and tests generate files of all sizes, from small spreadsheets to very large datasets from instruments, simulations or sensors. Teams need storage that is large enough, backed up and organized so files can be found months later.

Good practice usually includes:

  • A consistent folder and naming scheme, agreed by the team
  • Metadata, meaning information about the data: who produced it, when, with what instrument or settings
  • Separation of raw and processed data, so original measurements are never overwritten
  • Shared storage with access controls, so project members can reach what they need
  • Backups and tested restores, since irreplaceable data is common in research

Choices between local servers and cloud storage depend on data size, cost, speed of access and any rules about where data may be kept. Moving very large datasets over a network can be slow, a point related to network latency and bandwidth.

Tracking work and versions

Version control is as valuable for research as for software. Tracking changes in code, analysis scripts and written documents lets a team see who changed what, return to an earlier state and combine contributions without overwriting each other. Version control with Git is the best known example for code, though it handles very large files poorly, so teams often use separate approaches for big data.

Electronic lab notebooks serve a similar role in laboratories, replacing paper notes with searchable entries that can include data, images and protocols. They help others repeat the work and support claims about who did what and when, which can matter for patents. Specifics depend on the field and on legal advice.

Reproducibility

A frequent problem is that a result cannot be recreated later because the exact code, settings or software versions were not recorded. IT practices help here:

  • Record software versions and settings used for each analysis.
  • Keep analysis steps in scripts instead of manual clicking, which supports task automation.
  • Use configuration management or software containers so an environment can be rebuilt.
  • Store the link between final figures and the data and code that produced them.

These habits take effort at the time but save a great deal when a colleague, reviewer or future self asks how a number was obtained.

Collaboration tools

Teams communicate through chat, video meetings, shared documents and project boards. Features worth having include simultaneous editing, comments, task assignment and a searchable archive. For work with outside partners, such as universities or suppliers, organizations must decide how to give outsiders access without exposing everything. Guest accounts limited to a single project folder, with an expiry date, are a common approach. Where people sign in from different institutions, federated sign-in can reduce the number of passwords, in the spirit of single sign-on.

Meeting overload and scattered conversations are real hazards, so many teams set simple rules about where decisions are written down.

Computing power

Some R&D work needs more computing than a laptop provides: simulations, image processing, statistical modeling or training machine learning models. Options include shared servers, on-site clusters or renting capacity from cloud providers. Renting scales up quickly but costs can grow unexpectedly, as described in cloud costs. Teams usually benefit from scheduling and quotas so that one job does not use everything.

Protecting ideas and data

Research results and prototypes can be valuable and sometimes confidential. Protections include:

  1. Classifying information by sensitivity, as in data classification.
  2. Restricting access to need-to-know through role-based access and regular access reviews.
  3. Using data encryption for laptops, removable media and transfers.
  4. Training staff to recognize social engineering, which is often aimed at people who hold valuable knowledge.
  5. Having clear agreements on who owns the results, since ownership of discoveries is usually decided by contract and law, not IT.

Studies involving people or personal data bring extra obligations, such as consent and secure handling, and organizations typically involve ethics or privacy specialists.

Managing the balance

Researchers often prefer freedom to install tools and share work quickly. Security and IT teams want control and consistency. Both can be partly satisfied by offering a supported, easy default and a clear path to request exceptions. Asking the team what slows them down, then removing those barriers, tends to work better than restrictions alone.

Technology cannot supply the ideas, but it can ensure that data is findable, work is traceable and collaboration is smooth, which gives good ideas a better chance of being tested and built upon.

The complete guide to it in industry

How IT Supports Different Industries
Read the guide

Keep exploring

Guides from other topics

All topics →