Submitted by Sandra Pritz, General Secretary

The evaluation survey of IVETA products and services was conducted through a link from the members-only Intranet from January through March of 2007. There were only 25 respondents, so the results are not suited to the use of statistical processes. Of those who responded, 22 or 88% are individual members. Over half have been members for six years or more, and about a quarter have been members for only one year.

For a number of the survey items, a 5-point Likert scale is given, asking respondents to rate from 1 (low) to 5 (high). The common practice has been followed of assigning the term “neutral” or “medium” to a rating of 3, essentially meaning neither low nor high. This practice will be followed when grouping responses.

The following summary is intended to set forth the main “messages” expressed through the survey. Each item is listed in italics followed by the comments. In virtually every case, the closed-response item is paired with an open-ended item for explanation.

Membership:

Item: IVETA has four classifications of members (i.e. student, individual, non-profit and for-profit organizations), and has increasingly moving to an electronic format for all communications to keep costs down. Do you agree with this classification and approach?
It was noted, appropriately, that this item mixed two content topics and should have been split. Since 72% of the respondents chose “Yes,” it might be assumed that they meant yes on both counts. However, twelve people (48%) made comments, and only two of those indicated positives on both issues. Of those commenting about the classification, there was a roughly even split between those approving of the current system and those with suggestions for change, mostly to have sub-categories with greater specificity than the current system. Four comments about electronic communications indicated mixed reactions.

Item: Would you support an increase in dues to support more “hard copy” communications, and/or expanded services and products?
Almost two-thirds of the responses were positive, and approximately one-third negative. No one commented further.

Item: What ideas for outreach would you propose to increase membership? (IVETA now has about 250 members, but has not increased over the past several years)
A multiplicity of responses with a broad spread of ideas were voiced by 19 people (76% of those responding), which indicates that people were willing to take time to consider and share their thoughts on this important issue. The diversity of suggestions defies grouping or categorization and should be read one by one.

International and Regional Conferences: In addition to the Annual Mini-conference in conjunction with the American Career and Technical Education Association, IVETA co-sponsors International and Regional Conferences

Item: How useful are these Conferences to you? Rate from 1 (low) to 5 (high).
Although over one quarter of the respondents gave no opinion on this item, a majority of the total number of respondents (52%) gave a 4 or 5 rating, and only 8% a 1 or 2. Twelve percent gave a 3 rating.

Item: Have you attended any Conferences in the past 5 years?
A resounding two-thirds responded yes, and one third no.

Item: Should IVETA continue to co-sponsor these Conferences with partner countries?
All who responded (92%) said Yes, making this item one of the strongest indicators on the survey. Two respondents had no opinion. Twenty people provided suggestions, with the most frequent comments revolving around cost.

Annual Meeting: IVETA traditionally holds its Annual Meeting, including a mini-conference, just before the American Career and Technical Education Conference and Exhibition to take advantage of this opportunity and conserve travel costs for members.

Item: Should this format continue?
An almost three-fourths majority (72%) responded Yes. Twenty percent registered no opinion. Fifteen people commented, most of whom were in favor of the current procedure, with some additions/variation.

IVETA Internet Public Web Site (www.iveta.org). This site is one of IVETA’s major avenues of contact with its members and the general public.

Item: How useful is the public web site to you? Rate from 1 (low) to 5 (high).
A majority of the total number of respondents (56%) gave a 4 or 5 rating on this item, and only 12% responded with a 1 or 2. Over one quarter (28%) gave a 3 or “medium” rating.

Item: How often to you check the pubic internet Web Site for news and events about IVETA activities?
Almost half (48%) of the respondents responded “Usually after I get an EM about some IVETA related activity.” Another 32% responded, “Irregularly.” Only three respondents are accessing it frequently.

Item: Do you have any problem in downloading files (i.e. newsletter)?
A strong 84% are having no problem downloading files, and another 16% only sometimes.

Item: What suggestions would you have to improve the public web site?
The ten suggestions to improve the public web site were mixed in nature.

IVETA Intra Net Member Web Site (http://www.edupoli.fi/iveta). This site is only available to members (Access name is iveta password is intra)

Item: How useful is the member intranet to you? Rate from 1 (low) to 5 (high).
About a third of the total number of respondents (36%) gave a 4 or 5 rating on this item, and 20 % responded with a 1 or 2. Twenty percent gave a 3 or “medium” rating, and 24% had no opinion..

Item: How often to you check the member intranet Web Site for news and events about IVETA activities?
Only two people check the site frequently. A third check it irregularly and a quarter after being prompted by an email. Over a third rarely or have never checked it.

Item: What suggestions would you have to improve the intranet member web site?
Five members gave suggestions.

IVETA Newsletter: The IVETA newsletter is published and distributed in electronic form on the IVETA internet site (starting in 2006) on a quarterly basis.

Item: How useful is the newsletter to you? Rate from 1 (low) to 5 (high).
The newsletter got high usefulness ratings—80% of the respondents gave it a 4 or 5, and another 12% gave it a 3.

Item: How often to you read the newsletter for current news and events about IVETA activities?
It is important information that eighty percent of the respondents read the newsletter every quarter when it is distributed and another 12% after getting an email. This is clearly an important communication tool.

Item: Would you support the expansion of the newsletter into a longer “bulletin” that might highlight articles on key themes in TVET (i.e. alternatives for financing TVET, impact of the knowledge economy on TVET, alternatives for stimulating private and NGO sector delivery of TVET etc)? This would require more members, and others to get involved submitting articles.
Eighty percent responded Yes.

Item: What suggestions would you have to improve the newsletter?
The fourteen responses were varied.

IVETA Journal: The Journal has been published on a semi-annual basis since 1993, is a “refereed” journal, and the largest department of the Journal is devoted to empirical research articles. Starting in late 2006 it is being distributed to members in electronic form on the IVETA Intranet, with hard copies available at the cost of printing and postage.

Item: How useful is the Journal to you? Rate from 1 (low) to 5 (high)
Over half (56%) gave a 4 or 5 rating, with another quarter giving a medium 3 rating.

Item: How often to you read the Journal?
A majority (64%) of the respondents read the Journal every six months when it is distributed. The others read it irregularly or rarely.

Item: What suggestions, if any, would you have to improve the Journal (i.e., return to hard copy and increase member fees to cover full costs, reduce the emphasis on empirical research articles and put more emphasis on key emerging themes in TVET, make it a annual vs. semi-annual publication, etc,)?
This question elicited the greatest number of responses (25). These ranged from comments about its excellence to suggesting less emphasis on research to suggesting dropping the journal.

Professional Micro Grant Program (PMGP): The PMGP was started in 2002 to assist individual IVETA members from developing countries to experiment, adapt, and develop new approaches in VET and disseminate the results to the international VET Community. http://www.iveta.org/grant.htm It is financed from grants provided by Members and from IVETA, and provides grants up to USD 2,000.

Item: How useful do you think the PMGP is? Rate from 1 (low) to 5 (high).
Approximately one third (36%) responded with a 4 or 5. Over one quarter registered no opinion.

Item: Have you ever considered making a proposal for a grant?
Yes ( 8 ), No ( 76 ) Was Three quarters of the respondents said No. Sixteen percent were not aware of the opportunity, so the survey has served to make them aware.

Item: Have you ever considered making a grant to the PMGP fund?
Twenty percent responded Yes, 68% No, and 12% said they were not aware of the opportunity.

Item: What suggestions would you have to improve and publicize the PMGP?
Sixteen suggestions of a varied nature were made.

Overall Evaluation of IVETA: IVETA has been in existence for over 20 years, but has not been increasing in membership for the past several years, and we would like to increase membership and services.

Item: How useful is IVETA to you? Rate from 1 (low) to 5 (high)
More than half (52%) gave a 5 rating, and another quarter gave a 4 rating. Ratings of 3 and 2 were given by 16% and 8% of the respondents respectively, with no one giving a 1 or registering no opinion. The organization is greatly valued!

Item: Have you ever recommended membership to your colleagues?
Eighty-eight percent of the members responded Yes.

Item: What suggestions would you have to improve the administration and organization, publicity, and type of products and services that IVETA provides?
Only ten responses were made for improvements, while one person advised caution against changing services and processes built up over the years.
Participation in IVETA: IVETA is a volunteer organization, run for and by members.

Item: Which of the above listed activities would you be willing to assist in implementing (i.e. Newsletter development and editing, Journal development and editing, managing the Internet and Intranet, assisting with the Micro Grant Program including possibly making a donation to the revolving fund, helping with membership drives, serving as a member of the Executive Committee office, helping with organization of annual meetings and conferences, etc.)?
Fifteen people responded. Their names and willingness will be made available to the President.