Measuring IS Success: Quest for the Dependent Variable in IS Research The Journey Special IT Research Seminar William

2090 days ago, 849 views
PowerPoint PPT Presentation
IT Research Class February 10, 2003. Measuring IS Achievement: Mission for the Indigent Variable in IS Examination The Excursion Extraordinary IT Research Workshop William H. DeLone Kogod Institute of Business February 8, 2008. IS Achievement Research Stream.

Presentation Transcript

Slide 1

IT Research Seminar February 10, 2003 Measuring IS Success: Quest for the Dependent Variable in IS Research The Journey Special IT Research Seminar William H. DeLone Kogod School of Business February 8, 2008

Slide 2

IS Success Research Stream UCLA Dissertation – Successful utilization of IS by SMEs; MISQ 1988 IS Success: Quest for the Dependent Variable; ISR 1992 = "DeLone & McLean Success Model" Ten Year Update; JMIS, Spring 2003 Measuring E-Commerce Success, International Journal of Electronic Commerce, Fall 2004 IS Success Models, Dimensions, Measures, and Interrelationships, under audit European Journal of Information Systems

Slide 3

Research Motivation UCLA estimation course (Mason & Swanson) Peter Keen's 5 investigate challenges for MIS (ICIS 1) – What is the needy variable ? How does MIS set up an aggregate custom ? Subordinate variable for PhD examine in SMEs; Use & Impact If you can't gauge it, you can't inquire about it

Slide 4

Quest for MIS Dependent Variable (ISR, 1992) – "IS Success" Purposes Organize & compress MIS explore identified with characterizing the reliant variable Measure advance on characterizing the needy variable Improve IS research hone Contribute to "Combined Tradition" – make a relevant comparison

Slide 5

Theoretical Underpinnings Mason's 1978 article on measuring data yield Production->Product->Receipt->Influence on Recipient->Influence on System Mason's work depended on Shannon & Weaver's 1949 Theory of Communications book – Levels of interchanges estimation = specialized, semantic, viability DeLone & McLean Success Categories System Quality->Information Quality-> Use->Satisfaction->Individual Impact-> Organization Impact

Slide 6

Methodolgy Literature audit IS Articles from 1981 to 1988 Framework/show for sorting out achievement measures Empirical measures gathered into six achievement classes

Slide 7

Figure 1 D&M IS Success Model System Quality Use Individual Impact Organizational Impact Information Quality User Satisfaction D & M IS Success Model

Slide 8

Results/Conclusions A straightforward and niggardly structure for getting sorted out IS achievement measures IS Success - multi-dimensional and associated build Selection of measures is dependent upon goals and setting of study Reduce IS Success measures; expand on existing measures=> "total convention" – correlation of results Need for hierarchical effect measures

Slide 9

The Challenge " This achievement demonstrate obviously needs encourage improvement and approval before it could fill in as a reason for the determination of proper IS measures." (p.88)

Slide 10

Ten-Year Update ( JMIS 2003 ) Purposes Model Utility Validate the Model – Causal connections Update the Model to perceive the progressions in IS Assess advance in IS achievement estimation

Slide 11

Utility of D&M Success Model Cited by more than 285 refereed diary and procedures articles in the vicinity of 1993 and 2002 (as indicated by a current review in CAIS vol. 20, ISR 1992 article is the most refered to article in MIS in the course of the most recent 15 years; > 400 references) Most articles utilized the Model "as a lush uses a lamppost for support as opposed to enlightenment." Statement was dismisses by manager.

Slide 12

Model Validation Seddon & Kiew (1994) approved 4 of the proposed affiliations Rai et. al. approved general model utilizing integrity of fit tests (ISR 2002) Fifteen extra experimental reviews approved at least one proposed affiliations

Slide 13

Updated Model IS move from generation capacity to creation & benefit work => significance of administration quality Impacts on whom? People, bunches, organization., industry, economy => Net Benefits measurement with relevant definition

Slide 14

Updated Model

Slide 15

Assessment & Conclusions D&M IS Success Model bolstered and approved More cautious regard for multidimensionality of IS Success Confusion between Independent & Dependent factors Operationalization of the model is logical (Seddon et. al.) Progress in niggardly measure advancement is moderate System Use is misconstrued and underestimated Use and fulfillment are not a substitute for Net Benefits measures (Yuthas & Young, 1998)

Slide 16

Recent Advances in Success Measurement

Slide 17

Application of Model: E-Commerce Success ( IJEC 2004 ) Premise: E-trade does not require another estimation worldview but rather some new measures Apply the D&M IS Success Model for measuring E-Commerce Success Literature Review and grouping of developing web based business viability measures Case cases of utilization of IS Success Model to E-Commerce achievement estimation

Slide 18

Application of Model: ERP Success Article by Sedera & Gable (ICIS 2004) – Government & University ERPs Most far reaching observational trial of model Four measurements of IS Success – System quality Information quality Individual effect Organizational effect ** 27 Item measures

Slide 19

Validated Measures for IS Success Source: Sedera and Gable (2004) System Quality - convenience, simplicity of learning, client prerequisites, framework highlights, framework precision, adaptability, complexity, combination, and customization Information Quality – accessibility, ease of use, understandability, importance, arrangement, and brevity Individual Impact – learning, mindfulness/review, choice adequacy, and individual efficiency Organizational Impact - hierarchical costs, staff necessities, cost decrease, general profitability, enhanced results/yields, expanded limit, e-Government, and business handle change What happened to Use and User Satisfaction?

Slide 20

Measuring Systems/Information Usage (Don Marchand) Don Marchand, Professor of Strategy & Information Management at IMD – Switzerland 20% of significant worth acknowledgment is in sending: 80% of significant worth acknowledgment is in data and IT USAGE Challenge – Information Usage is hard to see, measure and oversee

Slide 21

Measuring System Usage (Burton-Jones & Straub, ISR 2006) Problem – over-streamlined measures of utilization; e.g. span of utilization and broadness of utilization Importance of setting & reason Elements of use include: frameworks, client and undertaking Proposed Dimensions of Systems Usage – Cognitive Absorption (engagement) + Deep Structure (utilization of framework elements that bolster a particular assignment) Systems Usage observationally identified with errand execution

Slide 22

Current Research Measuring IS Success: Models, Dimensions, Measures and Interrelationships under audit at European Journal of Information Systems Assessing the condition of IS Success Measurement (through D & M Model) Summarizing experimental writing, 1992 to 2006 Contributions Summarizes measures utilized for each measurement of accomplishment Validates noteworthy connections for 10 of the 15 causal connections in the Updated Success Model in view of exact reviews

Slide 23

Conclusions DeLone & McLean IS Success Model remains the most well known, far reaching structure for controlling the improvement of the reliant variable in IS research and for looking at results More IS specialists are utilizing the D&M Model to advise and manage their estimation of the needy variable as opposed to only legitimize their selection of measures Information quality and data utilize are under contemplated Satisfaction is over utilized as a surrogate for achievement; subsequently much data is lost Bias toward simplicity of information accumulation debilitates meticulousness and comprehension