Meisenbacher, Stephen and Nestorov, Svetlozar and Norlander, Peter (2025): Extracting O*NET Features from the NLx Corpus to Build Public Use Aggregate Labor Market Data.
Preview |
PDF
MPRA_paper_126336.pdf Download (6MB) | Preview |
Abstract
Data from online job postings are difficult to access and are not built in a standard or transparent manner. Data included in the standard taxonomy and occupational information database (O*NET) are updated infrequently and based on small survey samples. We adopt O*NET as a framework for building natural language processing tools that extract structured information from job postings. We publish the Job Ad Analysis Toolkit (JAAT), a collection of open-source tools built for this purpose, and demonstrate its reliability and accuracy in out-of-sample and LLM-as-judge testing. We extract more than 10 billion data points from more than 155 million online job ads provided by the National Labor Exchange (NLx) Research Hub, including O*NET tasks, occupation codes, tools, and technologies, as well as wages, skills, industry, and more features. We describe the construction of a dataset of occupation, state, and industry level features aggregated by monthly active jobs from 2015 – 2025. We illustrate the potential for research and future uses in education and workforce development.
| Item Type: | MPRA Paper |
|---|---|
| Original Title: | Extracting O*NET Features from the NLx Corpus to Build Public Use Aggregate Labor Market Data |
| Language: | English |
| Keywords: | Labor Market Information, Online Job Vacancies, NLP methods, ML, data transparency |
| Subjects: | J - Labor and Demographic Economics > J2 - Demand and Supply of Labor > J23 - Labor Demand J - Labor and Demographic Economics > J2 - Demand and Supply of Labor > J24 - Human Capital ; Skills ; Occupational Choice ; Labor Productivity J - Labor and Demographic Economics > J6 - Mobility, Unemployment, Vacancies, and Immigrant Workers > J63 - Turnover ; Vacancies ; Layoffs |
| Item ID: | 126336 |
| Depositing User: | Peter Norlander |
| Date Deposited: | 10 Oct 2025 01:22 |
| Last Modified: | 10 Oct 2025 01:22 |
| References: | Abend, Gabriel. 2023. Words and Distinctions for the Common Good: Practical Reason in the Logic of Social Science. Princeton University Press. Acemoglu, Daron, and David Autor. 2011. “Skills, tasks and technologies: Implications for employment and earnings.” In Handbook of labor economics. Vol. 4, 1043–1171. Elsevier. Adadi, Amina, and Mohammed Berrada. 2018. “Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI).” IEEE Access, 6: 52138–52160. AEA ‘Data Legality Policy and Explanations’ and ‘AEA Data and Code Availability Policy’. n.d.. Alabdulkareem, Ahmad, Morgan R. Frank, Lijun Sun, Bedoor AlShebli, C´esar Hidalgo, and Iyad Rahwan. 2018. “Unpacking the polarization of workplace skills.” Science Advances, 4(7). Anand, Sarthak, Jens-Joris Decorte, and Niels Lowie. 2022. “Is it Required? Ranking the Skills Required for a Job-Title.” arXiv:2212.08553 [cs]. Arnold, David, Simon Quach, and Bledi Taska. 2022. The impact of pay transparency in job postings on the labor market. SSRN. Atalay, Enghin, Phai Phongthiengtham, Sebastian Sotelo, and Daniel Tannenbaum. 2018. “New technologies and the labor market.” Journal of Monetary Economics, 97: 48–67. Atalay, Enghin, Phai Phongthiengtham, Sebastian Sotelo, and Daniel Tannenbaum. 2020. “The Evolution of Work in the United States.” American Economic Journal: Applied Economics, 12(2): 1–34. Autor, David, H. 2013. “The ‘task approach’ to labor markets: an overview.” Journal for Labour Market Research, 46(3): 185–199. Azar, Jos´e, Ioana Marinescu, and Marshall Steinbaum. 2022. “Labor Market Concentration.” Journal of Human Resources, 57(S): S167–S199. Publisher: University of Wisconsin Press. Balducchi, David, Randall Eberts, and Christopher O’Leary. 2004. “Labor Exchange Policy in the United States.” Upjohn Press. Banks, George C., Haley M. Woznyj, Ryan S. Wesslen, Katherine A. Frear, Gregory Berka, Eric D. Heggestad, and Heather L. Gordon. 2018. “Strategic Recruitment Across Borders: An Investigation of Multinational Enterprises.” Journal of Management, 45(2): 476–509. Bassier, Ihsaan, Alan Manning, and Barbara Petrongolo. 2025. “Vacancy Duration and Wages.” The Review of Economics and Statistics, 1–28. Batra, Honey, Amanda Michaud, and Simon Mongey. 2023. “Online job posts contain very little wage information.” National Bureau of Economic Research. Bell, Alex. 2020. “Job Amenities and Earnings Inequality.” Blinder, Alan S. 2009. “How many US jobs might be offshorable?” World Economics, 10(2): 41–78. Borgman, Christine L, and Philip E Bourne. 2021. “Why it takes a village to manage and share data.” arXiv preprint arXiv:2109.01694. Bowker, Geoffrey C., and Susan Leigh Star. 2000. Sorting Things Out: Classification and Its Consequences. Inside Technology, Cambridge, MA, USA:MIT Press. Brigham, Keith H., G. T. Lumpkin, G. Tyge Payne, and Miles A. Zachary. 2014. “Researching Long-Term Orientation: A Validation Study and Recommendations for Future Research.” Family Business Review, 27(1): 72–88. Publisher: SAGE Publications Inc. Brochet, Francois, Maria Loumioti, and George Serafeim. 2015. “Speaking of the short-term: disclosure horizon and managerial myopia.” Review of Accounting Studies, 20(3): 1122–1163. Bureau of Labor Statistics. 2025. “Union Members.” https://www.bls.gov/news.release/pdf/union2.pdf. Bureau of Labor Statistics, U.S. Department of Labor. 2025. “Job Openings and Labor Turnover Survey (JOLTS).” https://www.bls.gov/jlt/, Accessed: 2025-07-24. Carnevale, Anthony P., Tamara Jayasundera, and Dmitri Repnikov. 2014. “Understanding online job ads data.” A technical report. MS o. PP Center on Education and theWorkforce. https . . . . Chatterji, Aaron, Thomas Cunningham, David J. Deming, Zoe Hitzig, Christopher Ong, Carl Yan Shan, and Kevin Wadman. 2025. “How People Use ChatGPT.” Chen, Ciao-Wei, and Laura Yue Li. 2023. “Is hiring fast a good sign? The informativeness of job vacancy duration for future firm profitability.” Review of Accounting Studies, 28(3): 1316–1353. Choi, Hyeri, and Ioana Marinescu. 2024. “Data for labor market concentration using Lightcast (formerly Burning Glass Technologies).” Data in Brief, 55: 110647. Choudhury, Prithwiraj, Evan Starr, and Rajshree Agarwal. 2020. “Machine learning and human capital complementarities: Experimental evidence on bias mitigation.” Strategic Management Journal, 41(8): 1381–1411. 10.1002/smj.3152. Cifuentes, Manuel, Jon Boyer, David A. Lombardi, and Laura Punnett. 2010. “Use of O*NET as a job exposure matrix: A literature review.” American Journal of Industrial Medicine, 53(9): 898–914. 10.1002/ajim.20846. City of New York. 2025. “NYC Careers Portal.” http://www.nyc.gov/html/careers/html/search/search.shtml. Accessed March 24, 2025. Clemens, Jeffrey, Lisa B Kahn, and Jonathan Meer. 2021. “Dropouts need not apply? The minimum wage and skill upgrading.” Journal of Labor Economics, 39(S1): S107–S149. Cunningham, Jessica, Anna Hui, Julia Lane, and George Putnam. 2021. “A Value-Driven Approach to Building Data Infrastructures: The Example of the MidWest Collaborative.” Harvard Data Science Review, 4. Davis, Steven J., R. Jason Faberman, and John C. Haltiwanger. 2013. “The establishment level behavior of vacancies and hiring.” The Quarterly Journal of Economics, 128(2): 581–622. Decorte, Jens-Joris, Jeroen Van Hautte, Chris Develder, and Thomas Demeester. 2025. “Efficient Text Encoders for Labor Market Analysis.” IEEE Access, 13: 133596–133608. arXiv:2505.24640 [cs]. Decorte, Jens-Joris, Jeroen Van Hautte, Johannes Deleu, Chris Develder, and Thomas Demeester. 2023a. “Career Path Prediction using Resume Representation Learning and Skill-based Matching.” arXiv:2310.15636 [cs]. Decorte, Jens-Joris, Jeroen Van Hautte, Thomas Demeester, and Chris Develder. 2021. “JobBERT: Understanding Job Titles through Skills.” arXiv:2109.09605 [cs]. Decorte, Jens-Joris, Jeroen Van Hautte, Thomas Demeester, and Chris Develder. 2024. “SkillMatch: Evaluating Self-supervised Learning of Skill Relatedness.” arXiv:2410.05006 [cs]. Decorte, Jens-Joris, Matthias De Lange, and Jeroen Van Hautte. 2025. “Multilingual Job-BERT for Cross-Lingual Job Title Matching.” arXiv:2507.21609 [cs]. Decorte, Jens-Joris, Severine Verlinden, Jeroen Van Hautte, Johannes Deleu, Chris Develder, and Thomas Demeester. 2023b. “Extreme Multi-Label Skill Extraction Training using Large Language Models.” arXiv:2307.10778 [cs]. Deming, David J. 2017. “The Growing Importance of Social Skills in the Labor Market*.” The Quarterly Journal of Economics, 132(4): 1593–1640. DesJardine, Mark, and Pratima Bansal. 2019. “One Step Forward, Two Steps Back: How Negative External Evaluations Can Shorten Organizational Time Horizons.” Organization Science, 30(4): 761–780. DeVaro, Jed, and Peter Norlander. 2021. “Wage Theft, Economic Conditions, and Market Power: The Case of H-1B Workers.” SSRN. Dey, Matthew, and Susan Houseman. 2025. “The Rise of the Contract Workforce in US Manufacturing.” In The Changing Nature of Work. University of Chicago Press. Dingel, Jonathan I., and Brent Neiman. 2020. “How many jobs can be done at home?” Journal of Public Economics, 189. Eberts, Randall, and Christopher O’Leary. 2003. “A Frontline Decision Support System for Georgia Career Centers.” Book Chapters. Eloundou, Tyna, Sam Manning, Pamela Mishkin, and Daniel Rock. 2024. “GPTs are GPTs: Labor market impact potential of LLMs.” Science, 384(6702): 1306–1308. Frauenheim, Ed. 2007. “What Killed America’s Job Bank?” Workforce Management, 86(13): 33–. Gasco, Luis, Hermenegildo Fabregat, Laura Garc´ıa-Sardi˜na, Paula Estrella, Daniel Deniz, Alvaro Rodrigo, and Rabih Zbib. 2025. “Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Management.” arXiv:2507.13275 [cs]. Gathmann, Christina, Felix Grimm, and Erwin Winkler. 2024. “AI, Task Changes in Jobs, and Worker Reallocation.” CESifo Working Paper Series 11585. Gephart, Robert. 1997. “Hazardous measures: An interpretive textual analysis of quantitative sensemaking during crises.” Journal of Organizational Behavior: The International Journal of Industrial, Occupational and Organizational Psychology and Behavior, 18(S1): 583–622. Gerhart, Barry, Patrick M Wright, Gary C McMahan, and Scott A Snell. 2000. “Measurement error in research on human resources and firm performance: how much error is there and how does it influence effect size estimates?” Personnel psychology, 53(4): 803–834. Gibbons, Eric M., Allie Greenman, Peter Norlander, and Todd Sørensen. 2019. “Monopsony Power and Guest Worker Programs.” The Antitrust Bulletin, 64(4): 540–565. Gunning, David, Mark Stefik, Jaesik Choi, Timothy Miller, Simone Stumpf, and Guang-Zhong Yang. 2019. “XAI: Explainable artificial intelligence.” Science Robotics, 4(37). 48 Handa, Kunal, Alex Tamkin, Miles McCain, Saffron Huang, Esin Durmus, Sarah Heck, Jared Mueller, Jerry Hong, Stuart Ritchie, Tim Belonax, et al. 2025. “Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations.” arXiv preprint arXiv:2503.04761. Hansen, Stephen, Peter John Lambert, Nicholas Bloom, Steven J Davis, Raffaella Sadun, and Bledi Taska. 2023. “Remote work across jobs, companies, and space.” National Bureau of Economic Research. Haselhuhn, Michael P., Elaine M. Wong, and Margaret E. Ormiston. 2022. “Investors respond negatively to executives’ discussion of creativity.” Organizational Behavior and Human Decision Processes, 171. 10.1016/j.obhdp.2022.104155. Hashizume, Marissa. 2024. “Timing Fortune 500 Job Opportunities.” Hazell, Jonathon, Christina Patterson, Heather Sarsons, and Bledi Taska. 2022. “National wage setting.” University of Chicago, Becker Friedman Institute for Economics Working Paper, (2022-150). He, Pengcheng, Xiaodong Liu, Jianfeng Gao, andWeizhu Chen. 2021. “DeBERTa: Decodingenhanced BERT with Disentangled Attention.” Hershbein, Brad, and Lisa B. Kahn. 2018. “Do Recessions Accelerate Routine-Biased Technological Change? Evidence from Vacancy Postings.” American Economic Review, 108(7): 1737–1772. 10.1257/aer.20161570. Heyden, Mariano L. M., Jatinder S. Sidhu, and Henk W. Volberda. 2015. “The Conjoint Influence of Top and Middle Management Characteristics on Management Innovation.” Journal of Management, 44(4): 1505–1529. Hirsch, Lesley, and Anna Hui. 2024. “Reimagining the Workforce and Labor Market Information System for the 21st Century. Workforce Information Advisory Council Recommendations.” Holland, John L. 1997. Making vocational choices: A theory of vocational personalities and work environments, 3rd ed. Odessa, FL.:Psychological Assessment Resources. Horton, John J, and Prasanna Tambe. 2015. “Labor economists get their microscope: Big data and labor market analysis.” Big data, 3(3): 130–137. Horton, John J., and Prasanna Tambe. 2025. “The Death of a Technical Skill.” Information Systems Research. Howison, Mark. 2022. “Replication files for: ‘Occupational models from 42 million unstructured job postings’.” Howison, Mark, Joe Long, and Justine Hastings. 2023. “Recommending Career Transitions to Job Seekers Using Earnings Estimates, Skills Similarity, and Occupational Demand.” Howison, Mark, William O Ensor, Suraj Maharjan, Rahil Parikh, Srinivasan H Sengamedu, Paul Daniels, Amber Gaither, Carrie Yeats, Chandan K Reddy, and Justine S Hastings. 2025. “Extracting structured labor market information from job postings with generative ai.” Digital Government: Research and Practice, 6(1): 1–12. Kindermann, Bastian, Sebastian Beutel, Gonzalo Garcia de Lomana, Steffen Strese, David Bendig, and Malte Brettel. 2021. “Digital orientation: Conceptualization and operationalization of a new strategic orientation.” European Management Journal, 39(5): 645–657. Klein, Katherine, Mitchell Pontikes, Jeffrey A Dahlke, Dan J Putka, Brittany F Crawford, Matthew C Reeder, and Phil Lewis. 2025. “Identification of Emerging Tasks in the O* NET System: A Revised Approach.” Lancaster, Vicki, Devika Mahoney-Nair, and Nathaniel J Ratcliff. 2019. “Technology report review of burning glass job-ad data.” University of Virginia, Biocomplexity Institute and Initiative Social and Decision Analytics Division. Lane, Julia. 2020. Democratizing our data: A manifesto. MIT Press. Lane, Julia, and Nancy Potok. 2024. “Democratizing Data: Our Vision.” Harvard Data Science Review, , (Special Issue 4). https://hdsr.mitpress.mit.edu/pub/m1o4oblm. Lazer, David M. J., Alex Pentland, Duncan J. Watts, Sinan Aral, Susan Athey, Noshir Contractor, Deen Freelon, Sandra Gonzalez-Bailon, Gary King, Helen Margetts, Alondra Nelson, Matthew J. Salganik, Markus Strohmaier, Alessandro Vespignani, and Claudia Wagner. 2020. “Computational social science: Obstacles and opportunities.” Science, 369(6507): 1060–1062. Levy, Orly. 2005. “The influence of top management team attention patterns on global strategic posture of firms.” Journal of Organizational Behavior, 26(7): 797–819. 10.1002/job.340. Lewis, Phil, and Jeremiah Morris. 2024. “Supplementing the O* NET Sources of Additional Information: A Preliminary Exploration of the Use of ChatGPT.” Lewis, Phil, Christina Gregory, and Jeremiah Morris. 2025. “Adding Drone-Specific Tasks to the O* NET Database: Initial Identification of Emerging Tasks using ChatGPT.” Littman, Julie. 2021. “Why aren’t restaurant workers coming back? Here’s what the data shows.” Restaurant Dive. Lou, Bowen, and Lynn Wu. 2021. “AI on Drugs: Can Artificial Intelligence Accelerate Drug Development? Evidence from a Large-Scale Examination of Bio-Pharma Firms.” Management Information Systems Quarterly, 45(3): 1451–1482. Maffie, Michael David. 2023. “The mythology of ‘Big Data’ as a source of corporate power.” British Journal of Industrial Relations, 61(3): 674–696. 10.1111/bjir.12728. Marinescu, Ioana, and RonaldWolthoff. 2020. “Opening the Black Box of the Matching Function: The Power of Words.” Journal of Labor Economics, 38(2): 535–568. Publisher: The University of Chicago Press. McKenny, Aaron F., Herman Aguinis, Jeremy C. Short, and Aaron H. Anglin. 2018a. “What Doesn’t Get Measured Does Exist: Improving the Accuracy of Computer-Aided Text Analysis.” Journal of Management, 44(7): 2909–2933. 10.1177/0149206316657594. McKenny, Aaron F., Jeremy C. Short, David J. Ketchen Jr., G. Tyge Payne, and Todd W. Moss. 2018b. “Strategic entrepreneurial orientation: Configurations, performance, and the effects of industry and time.” Strategic Entrepreneurship Journal, 12(4): 504–521. 10.1002/sej.1291. Meisenbacher, Stephen, and Peter Norlander. 2022. “Machine learning classifiers of job advertisement text described in ‘Creating Data from Unstructured Text with Context Rule Assisted Machine Learning (CRAML).’.” 10.5281/zenodo.7454652. Meisenbacher, Stephen, and Peter Norlander. 2023. “Transforming Unstructured Text into Data with Context Rule Assisted Machine Learning (CRAML).” arXiv:2301.08549 [cs]. Moss, Todd W., Maija Renko, Emily Block, and Moriah Meyskens. 2018. “Funding the story of hybrid ventures: Crowdfunder lending preferences and linguistic hybridity.” Journal of Business Venturing, 33(5): 643–659. Mueller, Andreas I., Damian Osterwalder, Josef Zweim¨uller, and Andreas Kettemann. 2024. “Vacancy durations and entry wages: Evidence from linked vacancy–employer–employee data.” Review of Economic Studies, 91(3): 1807–1841. National Academy of Sciences. 2024. Artificial Intelligence and the Future of Work. Washington, D.C.:National Academies Press. National Academy of Sciences. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, D.C.:National Academies Press. Neuendorf, Kimberly A. 2017. The content analysis guidebook. Thousand Oaks, CA:Sage. Nguyen, Khanh Cao, Mike Zhang, Syrielle Montariol, and Antoine Bosselut. 2024. “Rethinking Skill Extraction in the Job Market Domain using Large Language Models.”arXiv:2402.03832 [cs]. O *NET Development, National Center for. 2025. “O*NET OnLine.” https://www.onetcenter.org/. Pencle, Nadra, and Irina M˘al˘aescu. 2016. “What’s in the Words? Development and Validation of a Multidimensional Dictionary for CSR and Application Using Prospectuses.” Journal of Emerging Technologies in Accounting, 13(2): 109–127. Price, Ronald N., Jason Boyda, and Kathleen Bobay. 2024. “Systems and Methods for Processing Data Using Interference and Analytics Engines.” U.S. Patent Application US20240289641A1. Putka, Dan J., Frederick L. Oswald, Richard N. Landers, Adam S. Beatty, Rodney A. McCloy, and Martin C. Yu. 2023. “Evaluating a Natural Language Processing Approach to Estimating KSA and Interest Job Analysis Ratings.” Journal of Business and Psychology, 38(2): 385– 410. Rounds, James. 2023. “Using Machine Learning to Develop Occupational Interest Profiles and High-Point Codes for the O* NET System.” National Center for O*NET Development. https://www.onetcenter.org/reports/MLOIPs.html. Rounds, James, Dan J. Putka, and P. Lewis. 2022. “Updating vocational interests information for the O* NET content model.” National Center for O*NET Development. https://www. onetcenter.org/dl files/Voc Interests.pdf. Rudin, Cynthia. 2018. “Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.” Russ, Daniel E., Kwan-Yuet Ho, Calvin A. Johnson, and Melissa C. Friesen. 2014. “Computer-Based Coding of Occupation Codes for Epidemiological Analyses.” 347–350. New York, NY, USA:IEEE. Russ, Daniel E, Pabitra Josse, Thomas Remen, Jonathan N Hofmann, Mark P Purdue, Jack Siemiatycki, Debra T Silverman, Yawei Zhang, Jerome Lavou´e, and Melissa C Friesen. 2023. “Evaluation of the updated SOCcer v2 algorithm for coding free-text job descriptions in three epidemiologic studies.” Annals of Work Exposures and Health, 67(6): 772–783. Sauerwald, Steve, and Peter Norlander. 2024. “Political Directors and the Recruitment of Foreign Workers.” Journal of Management. Publisher: SAGE Publications Inc. Schubert, Gregor, Anna Stansbury, and Bledi Taska. 2024. “Employer concentration and outside options.” SSRN. Short, Jeremy C., J. Christian Broberg, Claudia C. Cogliser, and Keith H. Brigham. 2009. “Construct Validation Using Computer-Aided Text Analysis (CATA).” Organizational Research Methods, 13(2): 320–347. Stall, Shelley, Lynn Yarmey, Joel Cutcher-Gershenfeld, Brooks Hanson, Kerstin Lehnert, Brian Nosek, Mark Parsons, Erin Robinson, and Lesley Wyborn. 2019. “Make scientific data FAIR.” Nature, 570(7759): 27–29. Bandiera abtest: a Cg type: Comment Number: 7759 Publisher: Nature Publishing Group Subject term: Databases, Research management, Policy, Publishing. U.S. Bureau of Labor Statistics. 2025a. “Occupational Employment Statistics Data.” https://www.bls.gov/oes/, Data extracted on July 24, 2025. U.S. Bureau of Labor Statistics. 2025b. “Quarterly Census of Employment and Wages (QCEW).” https://www.bls.gov/cew/downloadable-data-files.htm, Accessed on July 24, 2025. U.S. Department of Labor, Employment and Training Administration. 2022. “Career One Stop.” https://www.careeronestop.org/. Vaupel, Mario, David Bendig, Denise Fischer-Kreer, and Malte Brettel. 2023. “The Role of Share Repurchases for Firms’ Social and Environmental Sustainability.” Journal of Business Ethics, 183(2): 401–428. Wasi, Nada, and Aaron Flaaen. 2015. “Record linkage using Stata: Preprocessing, linking, and reviewing utilities.” The Stata Journal, 15(3): 672–697. ISBN: 1536-867X Publisher: SAGE Publications Sage CA: Los Angeles, CA. Weil, David. 2014. The Fissured Workplace. Harvard University Press. Yourish, Karen, Annie Daniel, Saurabh Datar, Isaac White, and Lazaro Gamio. 2025. “These Words Are Disappearing in the New Trump Administration.” The New York Times. Zachary, Miles A., Aaron McKenny, Jeremy Collin Short, and G. Tyge Payne. 2011. “Family Business and Market Orientation.” Family Business Review, 24(3): 233–251. Zhang, Mike, Kristian Jensen, Sif Sonniks, and Barbara Plank. 2022. “SkillSpan: Hard and Soft Skill Extraction from English Job Postings.” 4962–4984. Seattle, United States:Association forComputational Linguistics. Zheng, Lianmin, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao, Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. “Judging LLM-as-a-judge with MT-bench and Chatbot Arena.” NIPS ’23. Red Hook, NY, USA:Curran Associates Inc. Zweig, Ben. 2026. Job Architecture: Building a Language for Workforce Intelligence. S.l.:Wiley. |
| URI: | https://mpra.ub.uni-muenchen.de/id/eprint/126336 |

