Ken Kelley
Senior Associate Dean for Faculty and Research, and Edward F. Sorin Society Professor of IT, Analytics, and Operations
IT, Analytics, and Operations
574-631-5752
234B Mendoza College of Business
- Biography
- Background
- Publications
- Books
- Presentations
- Awards
- Grants
- Media
Ken Kelley is the Edward F. Sorin Society Professor of IT, Analytics, and Operations (ITAO) and the Senior Associate Dean for Faculty and Research in the Mendoza College of Business at the University of Notre Dame. Professor Kelley is in the analytics group within the ITAO Department and works to advance analytic methods in his research in a variety of ways from a variety of perspectives to improve the methods used in human-centered research, from the foundational area of psychology to applied areas in business. His work crosses several traditional disciplinary boundaries, which he believes is important when considering various aspects of the human condition. More specifically, he evaluates, improves, and develops methods to better study human-centered research from a methodological perspective. The entire effort is in the data science space, particularly from the psychometric and statistical traditions of framing inferential questions. His most significant methodological contributions are in research design involving the interplay between effect size, confidence intervals, statistical significance, and sample size planning. My work depends heavily on statistical computing, with most of the methods I have developed implemented in R packages (e.g., MBESS, BUCCS, SMRD). In addition to methodological work, he collaborates in a variety of human-centered areas in which I develop needed or apply advanced or nonstandard methods to best address questions. Kelley is co-director of the Human-centered Analytics Lab (HAL) in the Mendoza College of Business. HAL is an interdisciplinary mash-up of technology, psychology, methodology, and business.
Professor Kelley is an Accredited Professional Statistician™ (PStat®) by the American Statistical Association, former associate editor of Psychological Methods, recipient of the Anne Anastasi early career award by the American Psychological Association's Division of Evaluation, Measurement, & Statistics, an elected member of the Society of Multivariate Experimental Psychology, and a fellow of the American Psychological Association. Currently, Professor Kelley is a faculty affiliate of iNDustry Labs, which is an initiative to help advance the regional economy, particularly as they move toward more advanced manufacturing.
Education
Ph D, University of Notre Dame
MA, University of Notre Dame
BA, University of Cincinnati
Areas of Expertise
Methodology / Analytics
Statistical Methods / Business Analytics
Research Design / Sample Size Planning
Measurement / Psychometrics
Longitudinal Data Analysis / Analysis of Change
Editorial Boards
Associate Editor
Psychological Methods
January 1, 2013 - December 31, 2016
Psychological Methods
January 1, 2013 - December 31, 2016
Review Editor
Frontiers in Quantitative Psychology and Measurement
January 1, 2010 - December, 2016
Frontiers in Quantitative Psychology and Measurement
January 1, 2010 - December, 2016
Editorial Board Member
Psychological Methods
January 1, 2009 - December 31, 2012
Psychological Methods
January 1, 2009 - December 31, 2012
"Diversity in Frontline Employee Perspectives: Policies and Procedures, Training, and Leadership as Drivers of Service Equity", (With Eve Rosenzweig, Elliot Bendoly), Production and Operations Management - Accepted (awaiting publication)
"The Critical Challenge of using Large-scale Digital Experiment Platforms for Scientific Discovery", (With Sriram Somanchi, Ahmed Abbasi), MIS Quarterly - Accepted (awaiting publication)
"Sample size planning for replication studies: The devil is in the design", (With Samantha Anderson), Psychological Methods, 29, 2024
"Strategic Sourcing of Multi-Component Software Systems: The Case of Electronic Medical Records", (With Kaitlin Wowak, Sean Handley, Corey Angst), Decision Sciences, 55, 2024
"Examining User Heterogeneity in Digital Experiments", (With Sriram Somanchi, Ahmed Abbasi, D. Dobolyi, T. Yuan), ACM Transactions on Information Systems, 2023
"A Sequential Approach for Noninferiority or Equivalence of a Linear Contrast Under Cost Constraints", (With Bhargab Chattopadhyay, Tathagata Bandyopadhyay, Jishnu P.), Psychological Methods - Accepted (awaiting publication)
"Improved inference in mediation analysis: Introducing the model-based constrained optimization procedure", (With Davood Tofighi), Psychological Methods, 25, 2020
"Who says there's a problem? Preferences on the sending and receiving of prohibitive voice", (With K. MacMillan, Charlice Hurst, J. Howell, Jung), Human Relations, 73, 2020
"Indirect effects in sequential mediation models: Evaluating methods for hypothesis testing and confidence interval formation", (With Davood Tofighi), Multivariate Behavioral Research, 55, 2020
"Common language effect size for correlations", (With X. Liu, R. Carlson), The Journal of General Psychology, 46, 2019
"Virtuous cycles of service quality: An empirical test", (With E Rosenzweig, C Queenan), International Journal of Operations and Production Management, 39, 2019
"Sequential accuracy in parameter estimation for population correlation coefficients", (With Francis Bilson Darku, B. Chattopadhyay), Psychological Methods, 24, 2019
"Big data in psychological research: A framework for research advancement", (With Idris Adjerid), American Psychologist, 73, 2018
"A novel measure of effect size for mediation analysis", (With M Lachowicz, K Preacher), Psychological Methods, 23, 2018
"Accuracy in Parameter Estimation for a General Class of Effect Sizes: A Sequential Approach", (With F. Darku, B. Chattopadhyay), Psychological Methods, 2018
"Fixed effects models versus mixed effects models for clustered data: Reviewing the approaches, disentangling the differences, and making recommendations", (With D., McNeish), Psychological Methods, 24
"Estimating the standardized mean difference with minimum risk: Maximizing accuracy and minimizing cost with sequential estimation", (With B. Chattopadhyay), Psychological Methods, 22, 2017
"Antecedents of information systems sourcing strategies in U.S. hospitals: A longitudinal study", (With Corey Angst, Sean Handley, Kaitlin Wowak), Management Information Systems Quarterly (MISQ), 41, 2017
"Sample size planning for more accurate statistical power: A method adjusting sample effect sizes for publication bias and uncertainty.", (With Samantha Anderson, Scott Maxwell), Psychological Science, 28, 2017
"When Do IT Security Investments Matter? Accounting for the Influence of Institutional Factors in the Context of Healthcare Data Breaches", (With Corey Angst, Emily Block, J D'Arcy), Management Information Systems Quarterly, 41, 2017
"The role of non-numerical stimulus features in approximate number system training in preschoolers from low-income homes", (With M. Fuhs, N. McNeil, C. O'Rear, M Villano), Journal of Cognition and Development, 17, 2016
"Estimation of the coefficient of variation with minimum risk: A sequential method for minimizing sampling error and sampling cost", (With B Chattopadhyay), Multivariate Behavioral Research, 51, 2016
"Impact of network structure on malware propagation: A growth curve perspective", (With Hong Guo, Cheng H.K.), Journal of Management Information Systems, 33, 296-325, 33, 2016
"Assessing omitted confounder bias in multilevel mediation models", (With D. Tofighi), Multivariate Behavioral Research, 51, 2016
"Confidence intervals for population reliability coefficients: Evaluation of methods, recommendations, and software", (With S Pornprasertmanit), Psychological Methods, 21, 2016
"Understanding cycles of abuse: A multi-motive approach", (With L. Simon, Charlice Hurst, Timothy Judge), Journal of Applied Psychology, 100, 2015
"Group membership prediction when known groups consist of unknown subgroups: A Monte Carlo comparison of methods", (With W. Finch, J . Bolin), Frontiers in Quantitative Psychology and Measurement, 5, 2014
"The effects of perceived corporate social responsibility on employee attitudes", (With Glavas A.), Business Ethics Quarterly, 24, 2014
"What I experienced yesterday is who I am today: Relationship of work motivations and behaviors to within-individual variation in the five-factor model traits", (With Timothy Judge, C. Hurst, L Simon), Journal of Applied Psychology, 99, 2014
"An eye for relations: eye-tracking indicates long-term negative effects of operational thinking on understanding of math equivalence", (With D. Chesney, N. McNeil, J. Brockmole), Memory & Cognition, 41, 2013
"Accuracy in parameter estimation for ANCOVA and ANOVA contrasts: Sample size planning via narrow confidence intervals", (With K. Lai), British Journal of Mathematical and Statistical Psychology, 65, 2012
"Estimation of and confidence interval formation for reliability coefficients of homogeneous measurement instruments", (With Ying Cheng), Methodology, 8, 2012
"Longitudinal analysis of the relations between opportunities to learn about science and the development of interests related to science", (With Joyce Alexander, Kathy Johnson, ), Science Education, 96, 2012
"Longitudinal gender and age bias in a prominent amateur new media community", (With Jonathan Warren, S. Stoerger), New Media & Society, 14, 2012
"On effect size", (With K. Preacher), Psychological Methods, 17, 2012
"Sample size planning for composite reliability coefficients: Accuracy in parameter estimation via narrow confidence intervals", (With L. Terry, ), British Journal of Mathematical and Statistical Psychology, 65, 2012
"A comparison of two-group classification methods", (With J. Holden, W. Finch), Educational and Psychological Measurement, 71, 2011
"Accuracy in parameter estimation for targeted effects in structural equation modeling: Sample size planning for narrow confidence intervals", (With K. Lai), Psychological Methods, 16, 2011
"Accuracy in parameter estimation for the root mean square error of approximation: Sample size planning for narrow confidence intervals", (With Keke Lai), Multivariate Behavioral Research, 46, 2011
"Effect size measures for mediation models: Quantitative strategies for communicating indirect effects", (With K. Preacher), Psychological Methods, 16, 2011
"Sample Size Planning for Longitudinal Models: Accuracy in Parameter Estimation for Polynomial Change Parameters", (With Joseph Rausch), Psychological Methods, 16, 2011
"A priori Monte Carlo simulation (Entry)", In N. J. Salkind, D. M. Dougherty, & B. Frey (Eds.), Encyclopedia of research design, Thousand Oaks, CA: Sage, 1, 2010
"Accuracy in parameter estimation (AIPE) (Entry).", In N. J. Salkind, D. M. Dougherty, & B. Frey (Eds.), Encyclopedia of research design, Thousand Oaks, CA: Sage, 1, 2010
"MBESS (Entry)", In N. J. Salkind, D. M. Dougherty, & B. Frey (Eds.), Encyclopedia of research design, Thousand Oaks, CA: Sage, 2, 2010
"Monte Carlo Simulation Study (Entry)", In N. J. Salkind, D. M. Dougherty, & B. Frey (Eds.), Encyclopedia of research design, Thousand Oaks, CA: Sage, 2, 2010
"Sample size planning (Entry)", In I. B. Weiner & W. E. Craighead (Eds.). Corsini's Encyclopedia of Psychology, 3, 2010
"Sample size planning (Entry)", In N. J. Salkind, D. M. Dougherty, & B. Frey (Eds.), Encyclopedia of research design, Thousand Oaks, CA: Sage, 3, 2010
"Social contagion and information technology diffusion: The adoption of electronic medical records in U.S. hospitals", (With Corey Angst, R. Agarwal, V. Sambamurthy), Management Science, 56, 2010
"The effects of initially misclassified data on the effectiveness of discriminant function analysis and finite mixture modeling", (With J. Holden), Educational and Psychological Measurement, 70, 2010
"A comparison of linear and mixture models for discriminant analysis under nonnormality", (With J. Rausch), Behavior Research Methods, 41, 2009
"Estimation (point and interval) (Entry)", In L. E. Sullivan, R. B. Johnson, C. C. Mercado, & K. J. Terry (Eds.), The Sage glossary of the social and behavioral sciences , Thousand Oaks, CA: Sage, 2009
"The average rate of change for continuous time models", Behavior Research Methods, 41, 2009
"Analyzing change: A primer on multilevel models with applications to nephrology", (With J. Holden, R. Agarwal), American Journal of Nephrology, 28, 2008
"Delineating the average rate of change", (With S. Maxwell), Journal of Educational and Behavioral Statistics, 3, 2008
"Diagnosing hypertension by intradialytic blood pressure recordings", (With R. Agarwal, T. Metiku, G. Tegegne, R. Light, Z. Bunaye, D. Bekele), Clinical Journal of the American Society of Nephrology, 3, 2008
"Diagnosis for covariance structure models by analyzing the path", (With C. Kouros, K-H. Yuan), Structural Equation Modeling, 15, 2008
"Diagnostic utility of blood volume monitoring in hemodialysis patients", (With R. Agarwal, R. Light), American Journal of Kidney Diseases, 51, 2008
"Infant temperament moderates relations between maternal parenting in early childhood and children's adjustment in first grade", (With A. Stright, K. Gallagher), Child Development, 79, 2008
"Interpreting results of clinical trials: A conceptual framework", (With A. Singh, R. Agarwal), Clinical Journal of the American Society of Nephrology, 3, 2008
"Nonlinear change models in populations with unobserved heterogeneity", Methodology, 4, 2008
"Patterns of clinical functioning over time for young people served in a system of care", (With J. Anderson, E. Wright, H. Kooreman), Journal of Emotional and Behavioral Disorders, 16, 2008
"Sample size planning for statistical power and accuracy in parameter estimation", (With S. Maxwell, J. Rausch), Annual Review of Psychology, 59, 2008
"Sample size planning for the squared multiple correlation coefficient: Accuracy in parameter estimation via narrow confidence intervals", Multivariate Behavioral Research, 43, 2008
"The development of conceptual interests in young children", (With J. Alexander, K. Johnson, M. Leibham), Cognitive Development, 23, 2008
"Confidence intervals for standardized effect sizes: Theory, application, and implementation", Journal of Statistical Software, 20, 2007
"Methods for the Behavioral, Educational, and Social Sciences: An R Package", Behavior Research Methods, 39, 2007
"Proteinuria is a determinant of quality of life in diabetic nephropathy: Modeling lagged effects with path analysis", (With O. Aricak, R. Light, R. Agarwal), American Journal of Nephrology, 27, 2007
"Sample size planning for the coefficient of variation from the accuracy in parameter estimation approach", Behavior Research Methods, 39, 2007
"Trended cosinor change model for analyzing hemodynamic rhythm patterns in hemodialysis patients", (With R. Light, R. Agarwal), Hypertension, 50, 2007
"Nonlinear change models in heterogeneous populations: The latent classification differential change model", Proceedings of the International Conference on Development and Learning, 5, 2006
"Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals", (With J. Rausch), Psychological Methods, 2006
"The effects of nonnormal distributions on confidence intervals around the standardized mean difference: Bootstrap and parametric confidence intervals", Educational and Psychological Measurement , 65, 2005
"Assessing the assumption of symmetric proximity measures in the context of multidimensional scaling", Journal of Applied Measurement, 5, 2004
"Analytic methods for questions pertaining to a randomized pretest, posttest, follow-up design", (With J. Rausch, S. Maxwell), Journal of Clinical Child and Adolescent Psychology, 32, 2003
"Obtaining power or obtaining precision: Delineating methods of sample-size planning", (With S. Maxwell, J. Rausch), Evaluation and the Health Professions, 26, 2003
"Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant", (With S. Maxwell), Psychological Methods, 8, 2003
"Accuracy in parameter estimation (AIPE)", Encyclopedia of research design/Thousand Oaks, CA: Sage, 2, 2022 - Accepted (awaiting publication)
"MBESS", Encyclopedia of research design/Thousand Oaks, CA: Sage, 2, 2022 - Accepted (awaiting publication)
"Sample size planning", (With Samantha Anderson, Scott Maxwell), APA handbook of research methods in psychology, Volumne 1: Foundations, Planning, Measures, and Psychometrics. , 1, 2023
"Multilevel modeling using R (2nd ed.)", (With W. Finch, J. Holden), CRC, 2019
"Multiple Regression. In The reviewer's guide to quantitative methods in the social sciences (2nd edition)", (With Scott Maxwell), In G. R. Hancock, L. M. Stapleton, and R. O. Mueller (Eds.), Quantitative methods in the social and behavioral sciences: A guide for researchers and reviewers (2nd edition), 2019
"Sample size planning for confirmatory factor models: Power or accuracy for effects of interest in P Irwing, T. Booth, and D. Hughes (Eds) The Wiley handbook of psychometric testing", (With Keke Lai), Wiley, 2018
"Designing Experiments and Analyzing Data: A Model Comparison Perspective", (With Scott Maxwell, Harold Delaney), 2017
"Designing Experiments and Analyzing Data: A Model Comparison Perspective (3rd Edition)", (With S. Maxwell, H. Delaney), Routledge, 2017
"Multilevel Modeling in R", (With W. Finch, J. Bolin), CRC Press/Taylor & Francis, 2014
"Multiple Regression", (With Jocelyn Holden), Handbook of quantitative methods for educational research, 2013
"Effect size and sample size planning", The Oxford handbook of quantitative methods, 1, 2012
"Sample size planning", (With S. Maxwell), APA handbook of research methods in psychology, 1, 2012
"Sample size planning and ethics", (With S. Maxwell), Handbook of Ethics in Quantitative Methodology, 2011
"Multiple regression", (With S. Maxwell), In G. R. Hancock & R. O. Mueller (Eds.), The reviewers guide to quantitative methods in the social and behavioral sciences: A guide for researchers and reviewers, 1, 2010
"Sample size planning with applications to multiple regression: Power and accuracy for omnibus and targeted effects", In P. Alasuuta, L. Bickman, & J. Brannen (Eds), The Sage handbook of social research methods (with S. E. Maxwell), 2008
"Using R for data analysis: A best practice for research", In J. Osbourne (Ed.), Best practices in quantitative methods (with K. Lai & P-J. Wu), 2008
"Accurate estimation of effect sizes: A sequential approach for scientific advancement", International Conference of the ERCIM WG on Computational and Methodological Statistics (CMStatistics), 2022
"Accuracy in Parameter Estimation for Correlation Measures: A Sequential Approach", Society of Multivariate Experimental Psychology, 2018
"Recovering from a Crisis of Confidence: Designing and conducting effective replication studies", International Meeting of the Psychometric Society, 2018
"Assessing Omitted Confounder Bias in Multilevel Mediation Models", Modern Modeling Methods Conference, 2018
"Accuracy in Parameter Estimation for a General Class of Effect Size: A Sequential Approach", Society of Multivariate Experimental Psychology, 2017
"Accuracy in Parameter Estimation for a General Class of Effect Sizes: A Sequential Approach", Joint Statistics Meeting, 2017
"Minimum-risk Point-estimation for the Standardized Mean Difference Using Sequential Estimation", International Meeting of the Psychometric Society, 2016
"Service excellence in US hotels: A Longitudinal Analysis", Production and Operations Management Society, 2015
"Comments on my past work and future plans: Acceptance of the Anastasi Early Career Award", Annaul convention of the American Psychological Association , 2014
"A modern, general, and highly flexible approach to sample size planning for modern research designs", Annual Meeting of the American Psychological Association , 2014
"Monte Carlo simulation methods for modern designs: A general approach to sample size planning.", Joint Statistics Meeting, 2014
"Acceptance of the Best Paper in Methodology Award: Comments on Kelley and Cheng (2012, Methodology))", European Conference of Methodology, 2014
"A flexible approach to sample size planning for modern research questions", European Congress of Methodology, 2014
"National Culture and the Service-Profit Chain: A Longitudinal Study in the Hotel Industry", POMS: Production and Operations Management Society, 2013
"The Role of Differential Susceptibility in Infancy on the Cognitive, Behavioral and Psychosocial Outcomes of Young Children", Meeting of the International Conference on Infant Studies, 2012
"Classification in the presence of heterogeneous groups: A Monte Carlo comparison of several statistical methods", Annual meeting of the American Educational Research Association, 2012
"Accuracy in Parameter Estimation for Omnibus and Targeted Effects in Structural Equation Modeling: Sample Size Planning for Narrow Confidence Intervals", Annual Meeting of the American Psychological Association, 2011
"An evaluation of confidence intervals for composite reliability coefficients", Joint Statistics Meeting, 2011
"Sample size planning to obtain narrow confidence intervals for the RMSEA", International Meeting of the Psychometric Society, 2010
"Sample size planning to obtain narrow confidence intervals for the RMSEA.", Joint Statistics Meeting, 2010
"Accuracy in parameter estimation for group effects in longitudinal models: Sample size planning for narrow confidence intervals", Joint Statistics Meeting, 2009
"Accuracy in parameter estimation for the RMSEA", Psychonomic Society Annual Meeting, 2008
"The average rate of change in longitudinal models", Psychometric Society Annual Meeting, 2008
"Effects of misclassified data on two methods of classification analysis: A Monte Carlo simulation study", American Educational Research Association, 2008
"Accuracy in parameter estimation for composite reliability coefficients", American Psychological Association Annual Convention, 2007
"Accuracy in parameter estimation for omnibus and targeted effects in analysis of variance", American Psychological Association Annual Convention, 2007
"Accuracy in parameter estimation for standardized means, mean differences, and contrasts", American Educational Research Association Annual Meeting, 2007
"Temperament and parenting across early childhood: Growth mixture modeling using the NICHD Study of early child care", (with A. D. Stright), Society for Research in Child Development Meeting, 2007
"Sample size planning for the squared multiple correlation coefficient: Accuracy in Parameter Estimation via narrow confidence intervals", Psychometric Society Annual Meeting, 2006
"Children's temperament moderates the relations between maternal parenting and children's adjustment to school", (with A. D. Stright & K. C. Gallagher), American Educational Research Association Annual Meeting, 2006
"Estimating nonlinear growth models in heterogenous populations when class membership is unknown: Defining and developing the latent classification differential change model", Society of Multivariate Experimental Psychology, 2004
"Teacher aides, class size and academic achievement: An evaluation of Indiana's Prime Time", (with D. K. Lapsley, K. Daytner, and S. E. Maxwell), American Educational Research Association Annual Meeting, 2002
"95 Million t tests: The empirical findings when the assumption of independence is violated in the two-sample t test", Midwestern Psychological Association Annual Meeting, 2000
Award
"Barbara Byrne Award for Outstanding Book or Edited Volume (for Designing Experiments and Analyzing Data: A model comparison perspective, 2018, Maxwell, Delaney, & Kelley; 3rd ed.)", Society of Multivariate Experimental Psychology, 2022
"Outstanding Faculty Award", Master's of Science in Business Analytics, 2021
"40-Under-40 Outstanding MBA Professors", Poets & Quants , 2017
"Outstanding Faculty Award", Master's of Science in Business Analytics, 2016
"Eli J. and Helen Shaheen Graduate School Research Award in Social Science", University of Notre Dame, 2005
"Dissertation Fellowship", Department of Psychology, University of Notre Dame, 2004
"Dissertation Research Award", Society of Multivariate and Experimental Psychology, 2004
"Senior Man of the Year", Department of Psychology, University of Cincinnati, 2000
"Community and University Service Award", Cincinnati Psychological Association, 2000
"Outstanding Achievement Scholarship", Scholarship and Awards Committee of the College of Arts and Sciences, 1999
Fellows/Elected Memberships
Association for Psychological Science, Elected Fellow (Quantitative), 2024
American Psychological Association, Elected Fellow (Evaluation, Measurement, and Statistics), 2014
Sample size planning for effect sizes and an R package for implementation: Designing educational studies for accurate parameter estimates, Proffitt Fellowship for Educational Research, $40,000
Pathobiology of Kidney Disease: Role of iron, National Institutes of Health, $270,000
Accuracy in parameter estimation for standardized effect sizes related to means and ANOVAs, Proffitt Fellowship for Educational Research, $10,000
DataInformed, http://data-informed.com/what-is-the-most-underutilized-trend-in-data-analytics-qa-with-ken-kelley/, April 12, 2017