The following post originally appeared on the Original Thoughts blog.
Written by Tim Vines, Lindsay Morton and Adrian Stanley
The benefits of sharing research data are well-documented: improving understanding, enhancing research integrity, and enabling reproducibility and reuse (UNESCO 2023). Data sharing maximizes the impact of scholarly work. However, while the value of transparent research practices like data sharing, code sharing, and preprinting is widely recognized, implementing these practices consistently and effectively remains a significant challenge.
Leading publishers have policies to promote data sharing. For instance, Taylor & Francis and Springer Nature have implemented multiple levels of standardized data-sharing policies across their journals. Similarly, PLOS requires authors to make all data underlying their findings fully available without restriction at the time of publication.
Despite these policies and year-on-year improvements, the “State of Open Data 2024,” a special report from Figshare, Digital Science, and Springer Nature, highlights that bridging the gap between policy and practice remains challenging. The report emphasizes the need for continued efforts to align researcher behaviors with established data-sharing policies to fully realize the benefits of open data.
AI in Scholarly Communication: Transforming Transparency
AI has revolutionized scientific research, enabling large-scale, cross-disciplinary studies tackling challenges like climate change and public health. These same technologies can be equally transformative in scholarly communication.
Tools like DataSeer Snapshot, Clear Skies’ Papermill Alarm, and plagiarism detection software such as iThenticate, demonstrate AI’s ability to bridge the gap between theory and practice. By analyzing metadata and full text, flagging problematic submissions, and supporting compliance with funder mandates and journal policies, AI can make research transparency actionable and achievable.
AI publishing tools help us move transparent practices from aspirational ideals to standard operating procedures, enhancing research quality and integrity. In other words, think of using these tools like having an extra editorial assistant — one focused solely on research integrity, who consistently completes tasks and gives reasoned, well-documented explanations for their decisions. A key point is if journals aren’t using tools like this in the next 1-2 years, they are likely to fall behind key competitor journals.
Three pathways to change
AI supports research transparency and integrity in editorial offices through three key mechanisms: understanding, integration, and intervention.
1. Understanding: Benchmarking and tracking progress
AI enables unprecedented insights into research communication norms across journals, institutions, and disciplines. By consolidating metadata and overcoming inconsistencies, AI allows us to:
- Benchmark current practices
- Identify areas for improvement
- Measure the impact of interventions
For example, by leveraging reports generated by AI, publishers, funders, and institutions can track compliance with mandates and identify successful practices that can be scaled across the industry. Two excellent examples are the PLOS Open Science Indicators and Silverchair Sensus funder reports.
2. Integration: Meeting researchers where they are
Researchers are primarily focused on conducting research; any additional requirements must be seamlessly integrated into existing workflows to maximize uptake. AI tools embedded in submission systems—such as flagging missing research data links, and the presence of well written data availability statements during manuscript submission—make it easier for researchers to comply with transparency standards without disrupting their primary work. In the absence of integrated tools, checking for open data becomes yet another task that the Editorial Office has to take on, often with limited time and limited expertise in the various data types collected at that journal.
When tools like DataSeer Snapshot are embedded into a journal’s submission platform, or upstream or downstream workflows, policy compliance feels simpler for authors and editors alike, becoming a standard component of submission and assessment, rather than an adjunct.
3. Intervention: Using the carrot, stick, and helping hand to coach researchers to success
The idea that researchers can be motivated to comply with policies with only carrots (i.e., rewards) and sticks (i.e., punishments) is outdated. A third and perhaps more effective approach is accountability: meeting authors at their manuscript and pointing out any deficiencies.
- The carrot: Rewarding researchers who demonstrate transparency through recognition programs, such as certificates or tenure-friendly acknowledgments, can motivate compliance.
- The stick: Detecting and addressing research misconduct, such as figure manipulation or plagiarism, helps maintain the integrity of the scientific record.
- Accountability: Most errors are unintentional. AI tools provide automated guidance to authors and editors helping them meet consistent standards while freeing editors to focus on more complex and strategic parts of their job.
Balanced intervention not only improves compliance and the published research but also fosters a lasting culture of excellence in research practices. Over time, researchers and journals will gradually progress from less rigorous and transparent communications practices to more collaborative, open, and reproducible behaviors that sharing mandates are designed to encourage.
Harnessing AI as a force for good
While AI has raised concerns about enabling large-scale research fraud, it is also a powerful tool for promoting transparency and integrity. When informed by editorial ethics and human expertise, AI can:
- Identify potential ethical concerns quickly and effectively
- Provide tailored, real-time support to authors and editors
- Celebrate researchers who exemplify integrity
- Deliver actionable insights to inform future decisions
By harnessing AI to their own ends, publishers, funders, and institutions can collectively build a more transparent, trustworthy and policy compliant research ecosystem.
Takeaways
- AI can make transparency in research practical, scalable, and achievable.
- AI can offer signals, indicators, or even scoring on submissions to help filter articles needing more attention. One can also compare scores and signals across different AI tools.
- Seamless integration into workflows ensures researchers and editors comply with policy without additional burden or cost.
- Recognizing excellence and addressing errors collaboratively fosters a stronger research culture.
- Partnerships among stakeholders and AI developers are essential to drive systemic change.
- Using AI proactively safeguards the integrity of scholarly publishing while elevating its standards.
If you have questions or feedback on this blog, or would like to hear more specifically about what DataSeer SnapShot does, or receive free samples and assessment, please do contact the DataSeer team at dataseer@dataseer.ai
