The FQxI Metascience Project has set out to evaluate academic journals based on the quality and impact of their publications. For this purpose, we will leverage a human-curated dataset and automated (machine learning-based) data analysis techniques, culminating in a publicly accessible web-based dashboard. The project will focus on physics-oriented journals.
👩👨Peer Analysis: a group of physicists will review papers already published in high-impact academic journals within the physics literature. The goal is to create a reliable, human-curated dataset to assess the journals.
💻Automated Analysis: with the basis and insights from the human-curated dataset, the goal is to create a system for a large-scale analysis of the available physics literature. Datasets that will be used include the ArXiv dataset. This will be accomplished by deploying Natural Language Processing (rule-based and machine-learning-based) techniques to evaluate the quality and impact of scientific publications.
While we know the many limitations of these types of analysis, we believe it is essential to work in this direction in a principled and transparent way. Ultimately, our goal is to help our community of researchers and scientists by providing an honest assessment and actionable insights into the status of the scientific publication system. We thus invite anyone interested in reaching out.
Get Involved
FQxI has opened up to 200 paid positions for physics experts to review a series of papers published across ten different high-impact journals spanning ten years. You can find more information about what this entails and/or to fill out an application to review HERE.
Keep me posted
If you want to receive project updates, join our mailing list.
Sign up to receive monthly updates!
By clicking Subscribe, you agree to the processing of your email address in accordance with our privacy policy.