APPENDIX E-1
Summary of GILS Conference Survey Results

 Table of Contents

 

1.0. INTRODUCTION................................................................................................1
2.0. DATA MANAGEMENT AND ANALYSIS........................................................1
3.0. RESULTS.............................................................................................................1
       3.1. Characteristics of Respondents........................................................................1
       3.2. Respondents Definitions of GILS.....................................................................5
       3.3. Assessment of Key Issues...............................................................................7
       3.4. Additional Comments Provided by Respondents..............................................11
              3.4.1. "Questions and Issues" Responses.........................................................11
              3.4.2. "Complaints and Concerns" Responses..................................................12
              3.4.3. "Recommendation" Responses...............................................................14
              3.4.4. "General" Responses.............................................................................15
              3.4.5. "Here To Learn" Responses..................................................................15

Table E1-1: Settings in Which Respondents Work.........................................................2
Table E1-2: Field in Which Respondents Work.............................................................3
Table E1-3: Involvement with GILS..............................................................................3
Table E1-4: Respondent’s Agencies’ GILS Implementation...........................................4
Table E1-5: Familiarity with GILS Documents/Policies..................................................4
Table E1-6: Familiarity with GILS Documents/Policies (Reduced).................................5
Table E1-7: Definition of GILS – Functions..................................................................6
Table E1-8: Type of Information in GILS.....................................................................6
Table E1-9: Users of GILS..........................................................................................6
Table E1-10: GILS Coverage......................................................................................7
Table E1-11: Key Issues.............................................................................................8
Table E1-12: Key Issues (Reduced).............................................................................9
Table E1-13: Use of GILS.......................................................................................... 9
Table E1-14: Favorite Online Alternative to GILS........................................................10

 

1.0. INTRODUCTION

The following provides an analysis and interpretation of the results of a survey questionnaire distributed to participants at the Second Annual GILS Conference (November 13-14, 1996). Approximately 300 people were scheduled to attend the conference. A total of 181 completed questionnaires.

The questionnaire was intended primarily to solicit from people who could reasonably be expected to know about GILS their assessment of a set of key GILS issues. In addition, the survey offered the opportunity to collect information to gauge respondents knowledge and awareness of GILS-related policy and technologies. The questionnaire was passed out early on the first day of the Conference and was intended to gauge respondents’ assessments based on their existing knowledge rather than knowledge gained from the Conference.

 

2.0. DATA MANAGEMENT AND ANALYSIS

The questionnaire (see Appendix D-3 copy of survey instrument) included open- and closed-ended questions. Respondents were asked for minimal demographic information that would provide context as to the characteristics of the respondents and their responses. All data were entered into Access database and statistics generated via Excel. Once the data were entered, 20 randomly selected questionnaires (approximately 10%) and their corresponding database entries were reviewed for accuracy.

Simple descriptive statistics were produced for the data from the closed-ended questions. For the open-ended questions, content analysis was performed to categorize and understand responses. Preliminary coding categories were developed based on the actual data rather overlaying a coding scheme on the data.

 

3.0. RESULTS 

The following sections report on the results of the survey. Section 3.1 Characteristics of Respondents addresses the demographic information provided.\

3.1. Characteristics of Respondents

Questions 2 through 7 asked respondents for information about where they work, what type of work they do, their involvement with GILS, and their familiarity with GILS policies and documents.

Settings in Which Respondents Work
Question 2 asked respondents were asked to identify the setting that best described where they worked. Four named choices were offered with a fifth choice of "Other." Table E1-1 summarizes the data from Question 2. Given the venue and focus of the GILS Conference, it is not surprising that the vast majority of respondents work in Federal agencies. 

Table E1-1
Settings in Which Respondents Work 

Setting

N

%

Federal Agency

145

78%

State or Local Government

17

9%

Private Non-Profit Organization

6

3%

Private For-Profit Organization

6

3%

Library

4

2%

Contractor to agency

2

1%

Other

5

3%

TOTAL

185*

99%**

* Respondents marked multiple choices so N exceeds the 181 completed surveys.
** Total does not equal 100% due to rounding.

 

The category of "Other" included the following respondent-generated answers to identify further their settings:  

 

Years of Experience
Question 3 asked respondents for the years of experience they had in this setting. The average number of years was 15 years with a maximum of 37 years reported. The mode was 20 years, which indicates that the majority of respondents are not novices in their work settings. In fact, if one extrapolates an "age" of respondent based on their years in the setting, one can assume that the majority of respondents were between 40-50 years old (assume work life beginning at 21 plus 20 years in the setting).

Field in Which Respondents Work
Question 4 asked respondents to identify the field in which they worked. As in question 2, respondents were offered twelve named choices, with an additional choice of "Other." Table E1-2 summarizes the data from Question 4. 

Table E1-2
Field in Which Respondents Work
 

Setting

N

%

Records Management

67

34%

Information Resources Management

35

18%

Library/Information Center

29

15%

Public Information

19

10%

Program Office/Project Management

10

5%

Computer Systems

8

4%

Archives

7

4%

Chief Information Office

6

3%

Legal/Legislative

4

2%

Software Developer

3

2%

Sales/Marketing

3

2%

Research and Development

1

1%

Procurement/Contracting

0

0%

Other

8

4%

TOTAL

200*

104%**

* Respondents marked multiple choices so N exceeds the 181 completed surveys.
** Total does not equal 100% due to rounding.

 

The category of "Other" included the following respondent-generated descriptions to identify further their field of work: 

Respondent Involvement with GILS
Question 5 asked respondents about their involvement with GILS. Six named choices were available to the respondents, with an additional choice of "Other. Table E1-3 summarizes respondents answers. The majority of respondents have some involvement with GILS.

Table E1-3
Involvement with GILS
 

Involvement

N

%

Implementor

81

39%

GILS Record Creator/Maintainer

46

22%

User

39

19%

Policymaker

19

9%

Technical Standards Developer

5

2%

Information Reseller

4

2%

Integration/Interoperability

2

1%

Trainer/User Support

2

1%

Other

8

4%

TOTAL

206*

99%**

*Respondents marked multiple choices so N exceeds the 181 completed surveys.
**Total does not equal 100% due to rounding.

The category of "Other" included the following as stated by the respondents to identify further their involvement with GILS: 

In terms of the audience for which Conference was intended, the majority of respondents were involved in one way or another with GILS. The specifics of that GILS involvement was not addressed by the survey. For example, involvement as "user" did not specify the type of use nor the extent of GILS use by the respondents.

 

Agency Involvement with GILS

Question 6 asked respondents to describe their agencies’ involvement with GILS and their implementations. Table E1-4 summarizes the results from this question. 

Table E1-4
Respondent’s Agencies’ GILS Implementation
 

Agency Implementation

YES

NO

D/K

TOTAL

 

N

%

N

%

N

%

N

%*

Operates a GILS Server

66

46%

60

42%

16

11%

142

99%
Submits Records to Others

59

42%

59

42%

24

17%

142

101%
Part of Larger GILS Effort

69

51%

47

35%

20

15%

136

101%

* Total does not equal 100% due to rounding. 

Respondent Familiarity with GILS Documents & Policies
Question 7 attempted to gauge respondents current knowledge (prior to the Conference) of relevant GILS policies and documents. Respondents identified their familiarity on a Likert Scale with 1 = Very Familiar and 5 = Not Familiar. Table E1-5 summarizes the results from this question. 

Table E1-5
Familiarity with GILS Documents/Policies
 

GILS Documents/Policies 1 2 3 4 5 Blank Total
  N % N % N % N % N % N % N %
Federal GILS Policies 45 25 41 23 40 22 22 12 30 17 3 2 181 101
Agency’s GILS Policies 49 27 32 18 24 13 19 10 28 15 29** 16 181 99
NARA’s Guidelines 40 22 42 23 32 18 25 14 38 21 4 2 181 100
OMB Bulletin 95-01 40 22 46 25 30 17 28 15 34 19 3 2 181 100
Z39.50 Standard 7 4 31 17 45 25 35 19 57 31 6 3 181 99
FIPS No. 192 17 9 24 13 30 17 45 25 61 34 4 2 181 100
PRA 1995, GILS Section 45 25 36 20 45 25 28 15 25 14 2 1 181 100
The World Wide Web 72 40 49 27 30 17 17 9 11 6 2 1 181 100

* Total does not equal 100% due to rounding.
** Due to high number of conference attendees not employed by a federal agency. 

Another perspective on the answers to Question 7 is to collapse the cells for the Likert Scale choices into one for Familiar (comprising 1 and 2) and one for Not Familiar (comprising 4 and 5). This isolates the cells for Likert Scale choice 3. Table E1-6 presents this information. 

Table E1-6
Familiarity with GILS Documents/Policies (Reduced)

GILS Documents/Policies

Familiar

3

Not
Familiar

Blank

Total

  N % N % N % N % N %*
Federal GILS Policies 86 48 40 22 52 29 3 2 181 101
Agency’s GILS Policies 81 45 24 13 47 26 29 15 181 99
NARA’s Guidelines/Record creation 82 45 32 18 63 35 4 2 181 100
OMB Bulletin 95-01 86 48 30 17 62 34 3 2 181 101
Z39.50 Standard 38 21 45 25 92 51 6 3 181 100
FIPS No. 192 41 22 30 17 106 59 4 2 181 100
PRA 1995, GILS Section 81 45 45 25 53 29 2 1 181 100
The World Wide Web 121 67 30 17 28 15 2 1 181 100

When one looks at Table E1-6, it becomes evident that the majority of respondents do not have familiarity with some of the basic documents and policies that underpin the GILS effort. Less than half of the respondents stated familiarity with OMB 95-01. The responses to this question raise the issue of the extent and nature of training and education on GILS that has been available. Since Z39.50 is a key aspect of GILS, it is worrisome that only approximately 20% of the respondents were familiar with either the standard or the Federal Processing Standard, FIPS No. 192, that mandates the use of Z39.50 for agency GILS implementations.

 

3.2. Respondents Definitions of GILS

The researchers were interested in determining what respondents thought GILS was. Question 1 on the survey asked respondents to provide their definition of GILS. This was an open-ended question and respondents provided a wide range of answers to the questions. Content analysis was performed on the data and the answers were grouped into four categories based on the primary features or aspects of GILS contained in the definitions: 

Respondent definitions often addressed more than one feature or aspect. 

Within each of these categories, the content analysis revealed additional details that were also coded and grouped. The following tables (Table E1-7 through E1-10) summarize the results of the content analysis on the data provided in Question 1. For each table, the percentage of respondents describing that perspective on GILS is given. 

Table E1-7
Definition of GILS -- Functions
 

84% of respondents’ definitions characterized GILS in terms of its function(s):

Table E1-7
Definition of GILS -- Functions

Type of Function N %
Finding Aid 97 64%
Access 47 31%
IRM 4 3%
Collect 3 2%
Control 1 1%
TOTAL 152 99%*

The specific "functions" categories were defined based on the occurrence of words in the respondents’ definitions: 

Table E1-8
Type of Information in GILS
 

38% of respondents’ definitions characterized GILS in terms of the type(s) of information it comprises: 

Type of Information

N

%

Publications

18

26%

Resources

18

26%

Systems

12

17%

Records

16

23%

Services

5

7%

TOTAL 69

99%*

* Total does not equal 100% due to rounding. 

Table E1-9
Users of GILS
 

24% of respondent definitions characterized GILS in terms of the type of user(s): 

Type of Users

N

%

Public

32

74%

Agency

4

9%

Private

2

5%

Government

1

2%

Library

1

2%

Managers

1

2%

Researchers

1

2%

World

1

2%

TOTAL 43

98%*

* Total does not equal 100% due to rounding. 

Table E1-10
GILS Coverage
 

13% of respondent definitions characterized GILS in terms of its coverage: 

Coverage

N

%

Federal government information (no qualifier mentioned)

7

29%

Important/major/prime information

4

17%

Executive information

1

4%

Electronic information

1

4%

Useful information

1

4%

Other

10

42%

TOTAL 24

100%

 The category of "Other" in Table E1-10 includes the following limitations to GILS coverage: 

Additionally, seven (7) respondents indicated some aspect of GILS related to its centralization (2) or decentralization (5). Five (5) respondents mentioned standards including two (2) respondents specifically mentioned Z39.50. 

Other responses were difficult to categorize, but contain interesting and sometime quite honest comments about GILS: 

Overall, the answers to this question reveal a wide diversity in how people currently understand and are able to define GILS. Two key aspects of GILS does come through in the answers -- that its "users" are considered to be "public users," and its primary characteristic is as a "finding aid." 

 

3.3. Assessment of Key Issues 

As noted in the introduction, the primary purpose of this survey was to get input for the study on issues related to GILS. The researchers identified through the literature review, early data collection activities, and discussions with people knowledgeable about GILS a set of statements that reflected a preliminary list of issues related to GILS. Respondents were asked to state their agreement/disagreement with thirteen (13) statements and true or false for four (4) statements. Table E1-11 summarizes the data from the thirteen 13 statements. For those statements, respondents could choose on a five-point Likert Scale (1 = Strongly Agree and 5 = Strongly Disagree) or make the choice "Don’t Know" (D/K). Table E1-12 collapses cells for 1 and 2 together and for cells 4 and 5 together to indicate more general senses of agreement/disagreement with the statements. Table E1-13 summarizes the data from the true/false statements. 

Table E1-11
Key Issues

 

1

2

3

4

5

D/K

Blank

Total

Key Issue

N

%

N

%

N

%

N

%

N

%

N

%

N

%

N

%*

A purpose of GILS is to improve public access to government information

128

71

33

18

14

8

0

0

2

1

4

2

0

0

181

100

Every agency Web homepage should have a link to the agency’s GILS

97

54

46

25

15

8

2

1

3

2

15

8

3

2

181

100

GILS should be expanded through out the Federal government

73

40

43

24

24

13

5

3

5

3

25

14

6

3

181

100

A purpose of GILS is to help agency officials better manage agency information

51

28

49

27

32

18

19

10

10

6

16

9

4

2

181

100

More work needs to be done on the technical standards to support GILS operations

43

24

39

22

31

17

10

6

2

1

50

27

6

3

181

100

I am able to describe GILS accurately and fully to others

37

20

44

24

53

29

19

10

20

11

3

2

5

3

181

99

GILS has improved public access to Federal information

32

18

31

17

40

22

18

10

3

2

52

29

5

3

181

101

GILS is so valuable that, if it didn’t exist, we would have to create it

23

13

34

19

50

28

30

17

11

6

27

15

6

3

181

101

There is adequate policy guidance to direct the development and operation of GILS

12

7

27

15

46

25

34

19

12

7

43

24

7

4

181

101

The appropriate technology is readily available for implementing GILS

11

6

32

18

48

27

20

11

13

7

50

27

7

4

181

100

There is adequate technical implementation guidance for development and operating GILS

9

5

27

15

47

26

28

15

17

9

49

27

4

2

181

99

The World Wide Web reduces the need for GILS

9

5

20

11

28

15

49

27

39

22

29

16

7

4

181

100

GILS records represent the complete information resources of an agency

7

4

5

3

20

11

53

29

69

38

22

12

5

3

181

100

* Total does not equal 100% due to rounding. 

Table E1-12
Key Issues (Reduced)

 

Agree

3

Disagree

Blank

D/K

Total

Key Issue

N

%

N

%

N

%

N

%

N

%

N

%*

A purpose of GILS is to improve public access to government information

161

89

14

8

2

1

4

2

0

0

181

100

Every agency Web homepage should have a link to the agency’s GILS

143

79

15

8

5

4

15

8

3

2

181

101

GILS should be expanded through out the Federal government

116

64

24

13

10

6

25

14

6

3

181

100

A purpose of GILS is to help agency officials better manage agency information

100

55

32

18

29

16

16

9

4

2

181

100

More work needs to be done on the technical standards to support GILS operations

82

45

31

17

12

7

50

28

6

3

181

100

I am able to describe GILS accurately and fully to others

81

45

53

29

39

22

3

2

5

3

181

101

GILS has improved public access to Federal information

63

35

40

22

21

12

52

29

5

3

181

101

GILS is so valuable that, if it didn’t exist, we would have to create it

57

31

50

28

28

23

27

15

6

3

181

100

The appropriate technology is readily available for implementing GILS

43

24

48

27

33

18

50

27

7

4

181

100

There is adequate policy guidance to direct the development and operation of GILS

39

22

46

25

46

25

43

24

7

4

181

100

There is adequate technical implementation guidance for development and operating GILS

36

20

47

26

45

25

49

27

4

2

181

100

The World Wide Web reduces the need for GILS

29

16

28

15

88

49

29

16

7

4

181

100

GILS records represent the complete information resources of an agency

12

7

20

11

122

67

22

12

5

3

181

100

* Total does not equal 100% due to rounding. 

Questions 22 - 25 asked respondents about their use of GILS. Respondents marked True or False for their answers to these questions. Table E1-13 summarizes responses to these questions. 

Table E1-13
Use of GILS
 

 

True

False

Total

Use of GILS

N

%

N

%

N

%

I find useful information when I use GILS

84

46%

97

54%

181

100%

I often find links to GILS on the Web

53

29%

128

71%

181

100%

I often refer people to GILS when providing information

48

27%

133

73%

181

100%

I search GILS several times per day in my everyday work

6

3%

175

97%

181

100%

A large majority of respondents neither use GILS frequently nor do they refer people to GILS for finding information. A smaller majority (54%) do not find useful information when using GILS. Responses to these questions raise the question as to the utility people currently see GILS as providing.

 

Alternatives to GILS

Along with the questions related to what users think about GILS as reflected in answers to questions 22-25, another question (Question 8) asked users to identify their favorite online alternative (either Web-based or other) to GILS they use when trying to locate government information. This was an open-ended questions, and respondents answered ranged from "The Web" to specific "agency homepages" or agency locators such as "GPO Access." While many respondents noted more than one alternative, only the first listed was counted in Table E1-14, which shows a summary of responses to Question 8. A second part to Question 8 asked respondents to provide reasons why they liked the source listed in Question 8. The intention was to identify salient features or aspects of those sources to provide a primitive sense of "user requirements" for changes to GILS. In general, and with some notable exceptions, the responses to the second part of the question were not useful for the intended purposes. Table E1-14 is a list of some of the more interesting features of these alternative sources. 

Table E1-14
Favorite Online Alternative to GILS

Alternative Online Resource

N

%

Web

32

18%
Alta Vista

14

8%
Agency Homepage(s) (includes DefenseLink)

13

7%
GPO Access

11

6%
None**

7

4%
Fedworld

6

3%
Yahoo!

6

3%
No Access**

5

3%
White House website

4

2%
(unspecified) Search engine

4

2%
GPO Monthly Catalog

3

2%
Library of Congress (includes Thomas)

3

2%
Villanova

3

2%
Lexis/Nexis

2

1%
Lycos

2

1%
Netscape

2

1%
Webcrawler

2

1%
EPIC

1

1%
Excite

1

1%
Gopher

1

1%
Library

1

1%
metacrawler.cs.washington.edu

1

1%
Mosaic

1

1%
Nonprofit Advisor

1

1%
NSDI/FGDC

1

1%
Telnet

1

1%
Usenet

1

1%
WWW.strategics.ca

1

1%
Blank

51

28%
Totals 181

105%*

Respondents noted the following reasons for favoring the GILS alternatives listed in Table E1-14:

  • Ease of use
  • Access to multiple/a variety of official databases
  • Currentness
  • Pointers to nearest library
  • Helpful user's guide
  • Extensive index
  • Absence of advertising
  • Speed
  • Amount of information provided
  • Clear organization
  • Convenience/familiarity/lack of knowing alternatives
  • Keyword search capability
  • Comprehensiveness
  • Breadth/depth of subject matter
  • Support
  • Links to other government agencies/resources
  • Seeing a "better perspective (context) of" information
  • Size
  • Relevance of information retrieved
  • Synergy
  • Personal involvement in development/maintenance
  • Target audience
  • Standardization
  • Ability to search by document title
  • Variety of approaches to information organization
  • Wide availability
  • Graphics development and presentation
  • Efficiency
  • Intuitiveness
  • Support of libraries, public information , and preservation
  • Predictability
  • Results are clear
  • Simplicity
  • Familiarity
  • Support by federal agencies
  • Degree of organization
  • Definitiveness
  • Capable of complex searching
  • Interface
  • Solid data
  • Script-ability to allow access for other programs.
  • An important design question for GILS is whether GILS can be modified to address and accomplish these criteria and expectations of users. 

     

    3.4. Additional Comments Provided by Respondents 

    The survey included a final question (Question 26) that asked respondents to offer any additional comments, pose questions, identify key issues, or discuss topics not mentioned in the questionnaire. The intention of this question was to probe for respondents’ ideas that the GILS Team would consider in subsequent data collection activities. 

    This was an open-ended question, and respondents provided a wide range of responses. A preliminary categorization placed the questions into several broad groups: 

     

    3.4.1. "Questions and Issues" Responses 

     

    3.4.2. "Complaints and Concerns" Responses 

     

    3.4.3. "Recommendation" Responses 

    3.4.4. "General" Responses 

     

    3.4.5. "Here To Learn" Responses