Why survey What is evaluation What do we mean by significant information

1525 days ago, 460 views
PowerPoint PPT Presentation

Presentation Transcript

Slide 1

Why survey? What is evaluation? What do we mean by noteworthy information? Martha Kyrillidou Planning for Results: Making Data Work for You The Cato Institute, Washington, DC February 20, 2008

Slide 2

What's uniting us …

Slide 3

Overview 1. Start (Why do we evaluate?) "Why survey? What is appraisal? What do we mean by noteworthy information?" - Martha Kyrillidou (1&2) 2. Arrange for (What do we evaluate?) "Study Design" – Neal Kaske (2&3) "Execution Measures" – Rick Garcia (2&3) 3. Outline (How would we evaluate?) 4. Execute (Design in real life) "Investigation and Interpretation" - Ray Lyons (5) LibQUAL+®, MINES™, and Other Tools; Packaging Results to Communicate to Stakeholders Gary Roebuck and Kristina Justh (2,3,4,&5) 5. Examine and Interpret (What do the outcomes mean?) 6. Reflect and Initiate (What do we do with the outcomes?)

Slide 4

Clear and present threat Bangor University considers expelling bookkeepers posted by Blake on Thursday January 27, 2005 @07:30AM - 753 hits    Ms Information composes "News from the University of Wales Bangor in the UK. senior administration no longer feel that subject bookkeepers/scholarly contact custodians are required in the cutting edge scholastic library. They have made rebuilding recommendations which incorporate expelling everything except one of the subject administrators and a level of the library administration, including the Head of Bibliographic Services. The college administration feels that innovation has "deskilled" writing seeking. To the extent I know, this proposition is uncommon in the United Kingdom. Generally, there will remain 4 proficient curators serving a 'research-drove' college of 8,000 or more FTEs and with 8 library destinations. These will be the college administrator, listing custodian, acquisitions curator and Law bookkeeper. Has anything like this happened anyplace that you know of? Provided that this is true, what have been the impacts?

Slide 5

Assessment Librarian

Slide 6

Library of the Future Will Also Need . . . . . . To have it's own information gathering and administration work force, people who continually gather, dissect and plan gives an account of information with respect to what administrations are being utilized, which bits of the accumulation are getting the most noteworthy use, what materials are being loaned through interlibrary advance, and patrons' identity. Archiving the libraries commitments to quality educating, understudy results, investigate efficiency will get to be basic.

Slide 7

Technical Skills required Quantitative Analysis: SPSS Qualitative Analysis: Atlas.ti Data gathering: Custom Web interface, Survey Monkey, FormSpring Data stockpiling: SQL Server, Excel Reporting: Crystal Reports, SPSS, SQL Reporting Services, Excel, Word Web conveyance: Dundas Charts Web advancement: ASP.NET, C#, ColdFusion

Slide 8

Communication Skills required Communicating hierarchical vision and administration ethic Leadership in catching the future and getting it going Ability to step up and readiness to go out on a limb and gain from oversights Troubleshooting and being an autonomous mastermind Ability to work cooperatively and push ahead group and authoritative objectives

Slide 9

. . . outline a course for each attempt that we take the general population's cash for, perceive how well we are advancing, tell the general population how we are getting along, stop the things that don't work, and never quit enhancing the things that we believe merit putting resources into. President William J. Clinton, on marking the Government Performance and Results Act of 1993

Slide 10

What's driving the "appraisal" plan "Times are changing" Exploding development being used and uses of innovation Increased client desires for administrations, including quality and responsiveness Shrinking spending plans Justification for spending $$$ on assets, projects, and administrations Increasing rivalry for assets Cost investment funds and additionally reallocation Fighting to stay applicable

Slide 11

The Internet Goes to College Early information from ethnographic meetings "I utilize Google since I heard it looks for more things" (than different sources). "I trust I can discover anything on the Internet. There hasn't been anything I haven't possessed the capacity to discover." "In light of the fact that I'm sluggish." Books have "so much data that nobody can experience it all." I utilize "the Internet first since it is more advantageous." I go to the library "since that is the thing that instructors like." "Google has gotten me through school." Source: Steve Jones, The Internet Goes to College, ARL Talk

Slide 12

Libraries Remain a Credible Resource in 21 st Century 98% concur with articulation , "My … library contains data from tenable and known sources." Note . Computerized Library Federation and Council on Library and Information Resources. (2002). Measurements and Use of the Scholarly Information Environment.

Slide 13

OCLC Reports Sharing, Privacy and Trust in Our Networked World College Student's Perceptions: Libraries and Information Resources Perceptions of Libraries and Information Resources OCLC: http://www.oclc.org/reports/sharing/default.htm

Slide 14

"General" library mark Amazing steadiness of library client's wanted desires crosswise over Types of clients Languages Countries Some distinctions crosswise over orders 297,158 LibQUAL+® overview respondents

Slide 15

Towards what end The rising library client sees the requirement for an alternate sort of library – a library that serves as a wellspring of data prepared to be gotten to at whatever time, from anyplace, utilizing cutting edge advancements. Will we adequately interpret the solace and certification of human associations into a virtual reality that is dependable, solid, and ever present? What's more, will realizing be entirely as successful or somewhere down in this virtual universe of ceaseless communication with the aggregate computerized learning base? Thompson, Kyrillidou, Cook "Library Users' Service Desires" Library Quarterly (2008)

Slide 16

Library Assessment and its Global Dimensions Markets and individuals presented to monetary and social systems inconceivable before Competing universally Library clients presented to worldwide strengths Libraries confronting comparative difficulties Libraries as the Internet Libraries as Google Libraries as Collaborative Spaces

Slide 17

Defining Success in a Digital Environment Crafting new measures of progress. Moving from measuring contributions to yields and results Understanding effect of library parts and administrations. Conceding to subjective measures of progress: client recognitions, client achievement, making esteem, progressing authoritative objectives. Reallocating and overseeing abilities to concentrate on new meanings of accomplishment.

Slide 18

Thinking Strategically About Libraries' Futures What is the focal work of the library and in what manner would we be able to accomplish all the more, in an unexpected way, and at less cost? What essential arrangement of administrations does the library give that others can't? What new parts are required? What favorable circumstances does the library have? What will be the most required by our group of clients in the following decade? How is client conduct evolving? What ought to our libraries try to be quite a while from now? What are the ramifications of innovation driven change? What are the crucial elements in charge of the achievement of the library?

Slide 19

Library Assessment Library appraisal gives an organized procedure to find out about our groups, their work and the libraries association with what they do The data gained through library evaluation is utilized as a part of an iterative way to enhance library projects and administrations and make our libraries receptive to the necessities of our groups. Scholastic libraries don't exist in a vacuum however are a piece of a bigger establishment. Evaluation inside the foundation may occur in individual ranges and at the wide institutional level.

Slide 20

Assessment is… "… an organized procedure to find out about groups and assess how well the library underpins them." - Steve Hiller, Director of Assessment & Planning University of Washington Libraries

Slide 21

Free discourse divider, Charlottesville, Sept 2006

Slide 22

Evaluation – foci by Peter Brophy Inputs Processes Outputs Outcomes Impacts We have 2 million records As an aftereffect of our administration, mankind has beaten intestinal sickness We have the innovation to change information into data rich items 26 understudies have perused this paper We have conveyed one million reports Increasing trouble … Increasing value …

Slide 23

IFLA: Measuring Quality Resources, foundation: What administrations does the library offer? Utilize: How are the administrations acknowledged? Proficiency: Are the administrations offered cost-viably? Possibilities and Development: Are there adequate possibilities for future advancement? (an adjustment of the Balanced Score Card)

Slide 24

Assessment at ARL An entryway to appraisal instruments: StatsQUAL ®: ARL Statistics - E-Metrics LibQUAL+ ® - Service Quality and Satisfaction DigiQUAL ® MINES for Libraries ® Library Assessment Conferences – libraryassessment.org Library Assessment Blog – libraryassessment.info SPEC Kits Service Quality Evaluation Academy ESP Assessment (Making Library Assessment Work) Effective, Sustainable, Practical

Slide 25

Qualitative Profile Developing New Metrics (per Yvonna Lincoln) Uniqueness of accumulations Defining the estimation of consortia Administrative and budgetary efficiencies Student results/understudy learning/graduate achievement Contributions to staff/partners profitability Social systems/scholarly systems Generating new information Creating the aggregate great with reusable resources

Slide 26

How would you depict a Library? Broadness and nature of accumulations and administrations Sustained institutional responsibility to the library Distinctive assets in an assortment of media Services to the academic group Preservation of research assets Contributions of staff to the calling