[Purpose/Significance] This study proposes a citation pattern for identifying research contributions in scientific paper and refines its typology to offer an operational and structured classification standard. The aim is to support the automated analysis and evaluation of scientific papers and to enable the semantic-level quantification of research contributions. [Method/Process] The definitions and classification frameworks of research contributions were systematically reviewed to clarify their essential characteristics. Based on a large-scale corpus of English citation sentences, typical organizational structures of contribution expressions were identified, citation patterns were extracted, and the classification dimensions of the core elements within the pattern were further refined. [Result/Conclusion] A citation pattern for research contributions was established, formulated as: research contribution = contribution field + innovative work + influence value. Innovative work was categorized into four types: theoretical, methodological, applied, and cognitive. Influence value was classified along two horizontal dimensions and four vertical levels. The proposed citation pattern and classification framework provide a foundation for the automated identification and quantitative evaluation of research contributions and offer methodological support for advancing academic assessment from traditional bibliometric indicators to semantic-level analysis.
Zhao Yang
,
Zhang Zhixiong
. Research on the Citation Patterns of Research Contribution in Scientific Papers[J]. Library and Information Service, 2026
, 70(8)
: 113
-122
.
DOI: 10.13266/j.issn.0252-3116.2026.08.009
[1] 工业和信息化部办公厅.关于完善工业和信息化领域科技成果评价机制的实施方案(试行)[EB/OL].[2025-09-04]. https://www.gov.cn/zhengce/zhengceku/2022-12/31/5734406/files/85066466c16140fbbe086e8b32f315ba.pdf. (Ministry of Industry and Information Technology of the People’s Republic of China.Implementation plan for improving the evaluation mechanism of scientific and technological achievements in the field of industry and information technology(trial)[EB/OL].[2025-09-04].https://www.gov.cn/zhengce/zhengceku/2022-12/31/5734406/files/85066466c16140fbbe086e8b32f315ba.pdf.)
[2] 学术桥.教育部学位中心主任:评价重点要转向贡献度[EB/OL].[2025-09-04]. https://www.acabridge.cn/xsps/zjgd/202309/t20230904_2459338.shtml. (Academic Bridge. Director of the academic degrees center of the ministry of education:The focus of evaluation should shift to contribution[EB/OL].[2025-09-04]. https://www.acabridge.cn/xsps/zjgd/202309/t20230904_2459338.shtml.)
[3] CHEN H, NGUYEN H, ALGHAMDI A. Constructing a high-quality dataset for automated creation of summaries of fundamental contributions of research articles[J]. Scientometrics,2022, 127:7061-7075.
[4] WHITLEY R. The intellectual and social organization of the sciences[M]. Oxford:Oxford University Press, 2000.
[5] MARKOV K, IVANOVA K, VELYCHKO V. Usefulness of scientific contributions[J]. Information theories and applications,2013, 20(1):4-38.
[6] CHAO W, CHEN M, ZHOU X. et al. A joint framework for identifying the type and arguments of scientific contribution[J].Scientometrics, 2023, 128:3347-3376.
[7] WOBBROCK J O, KIENTZ J A. Research contributions in human-computer interaction[J]. Interactions, 2016, 23(3):38-44.
[8] LIU M H, YEN A Z, HUANG H H, et al. ContributionSum:Generating disentangled contributions for scientific papers[C] //Proceedings of the 32nd ACM international conference on information and knowledge management. New York, United States:Association for Computing Machinery, 2023:5351-5355.
[9] 索传军,于果鑫.学术论文研究亮点的语言学特征与分布规律研究[J].图书情报工作, 2020, 64(9):104-113.(SUO C J,YU G X. Exploration of the research“highlights” in academic papers[J]. Library and information service, 2020, 64(9):104-113.)
[10] 章成志,李铮.基于学术论文全文的创新研究评价句抽取研究[J].数据分析与知识发现, 2019, 3(10):12-19.(ZHANG C Z, LI Z. Extracting sentences of research originality from full text academic articles[J]. Data analysis and knowledge discovery,2019, 3(10):12-19.)
[11] 罗卓然,蔡乐,钱佳佳,等.学术论文创新贡献句识别研究[J].图书情报工作, 2021, 65(12):93-100.(LUO Z R, CAI L, QIAN J J, LU W. Research on the recognition of innovative contribution sentences of academic papers[J]. Library and information service,2021, 65(12):93-100.)
[12] INTERPRETATION O, COOK H P, TREDENNICK H. Loeb classical library[M]. Cambridge, Massachusetts:Harvard University Press, 1938.
[13] CARROLL S, GOODSTEIN D. Defining the scientific method[J]. Nature methods, 2009, 6(4):237.
[14] KUHN, T. S. The structure of scientific revolutions[M]. Chicago:University of Chicago Press, 1962.
[15] JULIUS H, COMROE JR, ROBERT D D. Scientific basis for the support of biomedical science[M]. The ethical dimensions of the biological and health sciences. 2nd ed. Cambridge, UK:Cambridge University Press, 2002:327-340.
[16] D’SOUZA J, AUER S. NLPContributions:An annotation scheme for machine reading of scholarly contributions in natural language processing literature[EB/OL]. arXiv preprint arXiv:2006.12870, 2020.
[17] PRAMANICK A, HOU Y, MOHAMMAD S M, et al. The nature of NLP:Analyzing contributions in NLP papers[EB/OL]. arXiv preprint arXiv:2409.19505, 2024.
[18] 蔡乐,罗卓然,陆伟.学术论文科研贡献类型自动识别研究[J].情报理论与实践, 2023, 46(6):168-175.(CAI L, LUO Z R,LU W. Research on automatic recognition of scientific research contribution types of academic papers[J]. Information studies:theory&application, 2023, 46(6):168-175.)
[19] 曹树金,闫欣阳,张倩,等.中外情报学论文创新性特征研究[J].图书情报工作, 2020, 64(1):80-92.(CAO S J, YAN X Y, ZHANG Q, et al. Research on characteristics of innovation in Chinese and international academic literature of information science[J] Library and information service, 2020, 64(1):80-92.)
[20] LEAHEY E, LEE J, FUNK R J. What types of novelty are most disruptive?[J]. American sociological review, 2023, 88(3):562-597.
[21] GUPTA S, MANNING C D. Analyzing the dynamics of research by extracting key aspects of scientific papers[C] //Proceedings of5th international joint conference on natural language processing.Chiang Mai, Thailand:WANG H F, David YAROWSKY D,2011:1-9.
[22] BROOKES B C. The foundations of information science Part I:Philosophical aspects[J]. Journal of information science, 1980(2):125-133.
[23] BURAWOY M. For Public Sociology[J]. American Sociological Review, 2005, 70(1):21-42.
[24] JONG S D, BARKER K, COX D, et al. Understanding societal impact through productive interactions:ICT research as a case[J].Research evaluation, 2014, 23(2):89-102.
[25] 吕宇涵.基于引用评论加权的学者论文代表作量化遴选研究[D].太原:山西大学, 2023.(LV Y H. Research on Quantitative selection of representative works of papers based on citation and commentary weighting[D]. Shanxi Taiyuan:Shanxi University,2023.)
