1 / 22

Client Satisfaction Survey

what’s possible. Client Satisfaction Survey. Report on the findings of the CSAI Success Grants Applicants’ Satisfaction with the Grant Application Process and Procedures. Belgrade, July 2010. Content. Introduction Research Objectives Key Findings Analysis. Introduction/ Background.

vidor
Download Presentation

Client Satisfaction Survey

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. what’s possible Client Satisfaction Survey Report on the findings of the CSAI Success Grants Applicants’ Satisfaction with the Grant Application Process and Procedures Belgrade, July 2010

  2. Content • Introduction • Research Objectives • Key Findings • Analysis

  3. Introduction/Background ISC/CSAI announced an RFA for its Success Grants Program on March 17, 2010. The purpose of this RFA was to solicit project proposals from CSOs operating in Serbia for the purpose of using mass media tools and new technologies to successfully promote their results and impacts in order to increase the overall visibility of CSOs. In the second halh of May 2010, ISC/CSAI organized an on-line survey to find out what Success Grants Applicants think and feel about CSAI’s application process and procedures. The main purpose of the survey was to collect feedback in order to change and adjust future CSAI Requests for Applications. The survey was anonymous; respondents did not have to leave any records regarding their organizations or themselves. Also - as it was noted to respondents - their participation in the survey, as well as their opinions and attitudes, did not in any way affected the evaluation of their project proposals.

  4. Introduction/Methodology • Method of data collection: Internet Based Questionnaire • Population: 111 CSAI Success Grants Applicants • Targeted Sample: All Applicants • Sample Size: N=102 (92% of the Total Population) • Data collection was conducted from May 10 – 27, 2010

  5. Research Objectives • The objective of this research was to collect and analyze applicants’ feedback regarding: • Manner of RFA announcement and channels used; • Application Documents (including ISC Application Form and ISC Budget Form); • RFA timelines; • Project Proposal method of submission to ISC; • General attitudes about the Application process and procedures.

  6. Key Findings/Overall Satisfaction with the Application Process Base: N=100 How would you rate the overall application process? Average Score (on a scale of 1- 5) It is fair to say that almost all respondents are satisfied with the Application Process in general, with 46% of respondents stating Absolutely satisfied, and 44% stating Satisfied.

  7. Key Findings/Information (Re)sources Base: N=102 Where did you first find out about ISC/CSAI’s Success Grants RFA? Top Channels Other Channels ISC Serbia website, ISC mailing list and CDNPS mailing list seem to be the most valuable sources of information for CSO’s interested in ISC/CSAI RFAs. Receiving inputs from other CSO’s regarding funding opportunities seems to be another way of acquiring the information.

  8. Key Findings/RFA Narrative 6% Base: N=101 Did the Narrative Section of the RFA clearly articulated what kind of projects ISC/CSAI intends to support trough the Success Grants Program? Average Rate (on a 1-4 rating scale) The Success Grants RFA Narrative was highly rated among all respondents, with average rate of 3.44, on a 1 -4 scale. Half of the respondents consider the RFA Narrative to be Absolutely Clear.

  9. Key Findings/YouTube video Base: N=101 How did you feel about having the option of using YouTube videos as part of the application? Average Score (on a scale of 1- 4) Submitting YouTube videos as part of the application for the Success Grants RFA was highly rated amongst a vast majority of respondents, with the average scores of 3.42 on a 1-4 point scale. More than half of the respondents Liked very much that option.

  10. Key Findings/Application in English Base: N=101 How difficult was it to complete the application in English? Completing the application in English was easy for the majority of respondents. Only 3% of respondents found it to be somewhat difficult.

  11. Key Findings/Relevance of ISC Application Form Questions RELEVANCE 96% 99% 96% 95% 99% 95% 94% 98% 94% Base: N=101 Where questions in different sections of the ISC Application Form relevant? More than 90% of respondents feel questions in the Application Form were AbsolutelyRelevant or Relevant. Seems that follow-up activities and Org’s experience in media campaigns caused some minor misunderstandings.

  12. Key Findings/Budget Form I Base: N=101 How difficult was it to complete the ISC Budget Form? More than two thirds (77%) of respondents didn’t find it difficult to complete the budget form, in general. However, some respondents had some difficulties regarding different features of the ISC Budget Form. Classification of the findings can be found on the next slide.

  13. Key Findings/Budget Form II Base: N=18 Was there anything particularly difficult about the ISC Budget Form?

  14. Key Findings/Budget Instructions I Base: N=101 • Did the Budget Instructions provided clear directions as to how ISC funds should be used by grantees? Half of the respondents responded that the budget instruction were Mostly Clear. In general, 88% of the respondents feel that the budget instructions were clear. However, a number of respondents had some difficulties to clearly understand specific Budget Instructions. Classification of these difficulties are presented on the next slide.

  15. Key Findings/Budget Instructions II Base: N=13 Where there any specific budget instructions you found hard to understand?

  16. Key Findings/Time Base: N=101 Was the 1-month timeframe sufficient to complete the application? More than three quarters of respondents had enough time (6% had more than enough) to complete the application. However, a significant number – almost one quarter of all respondents - needed more than a month, mostly because it took time to reach agreements with media outlets (key partners in this program).

  17. Key Findings/Application Submission Base: N=100 How does your organization prefer to submit applications? Average Score (on a scale of 1- 4) Using e-mail is the most preferred way to submit project proposals.

  18. Results Analysis A high response rate to the survey is the first “result” that merits attention, and safely allows for conclusions to be drawn. The fact that 102 organizations, out of 111 (92%), took part in the survey, leads to the conclusion that CSOs are very interested and motivated to participate in these kinds of surveys and that they appreciate the fact that somebody (no other than donor organization) wants to hear their opinions and attitudes. Like one of the respondents noticed: “It’s nice of you to ask about these kinds of things. I have a feeling that most of the donors are not doing this (client satisfaction surveys), which leaves their application procedures non-transparent for those using them.” It can be argued that organizations felt pressured to take part in the survey, given that the survey was organized during the project proposal evaluation process, despite the fact that they were, on several occasions, assured that the survey was anonymous; and that their participation in the survey, as well as their opinions and attitudes expressed within, would in no way affect the evaluation of their proposal. This “pressure”, and the general type of relationship existing between donors and CSOs is something that should be taken in consideration when interpreting results. Also, this high response rate allows us to safely make conclusions in regards to the entire population.

  19. Results Analysis Overall satisfaction: Having 90% of all respondents satisfied with the overall Application Process (46% of respondents feeling Absolutely satisfied; and 44% feeling Satisfied) is an impressive achievement. Application Form: More than 90% of respondents felt that the questions in the Application Form sections (Justification and Background, Project Goal and Objectives, Expected Results, Target Groups, Description of Activities, Management Team, Follow up Activities, Brief description of organization, Organization’s experience in media campaigns) were AbsolutelyRelevant (score ranges from 64% to 85%, depending on the section) and/or Relevant (14% to 34%). It seems that only follow-up activities and organization’s experience in media campaigns caused some minor misunderstandings. RFA Announcment: The Success Grants RFA Narrative was highly rated by all respondents, with an average scores of 3.44 (on a scale of 1 – 4). One half of the respondents consider the RFA Narrative to be Absolutely Clear.

  20. Results Analysis Budget Form & Instructions: The budget form did not cause too many difficulties to respondents, at least according to the survey results. However, compared to the Application form, some features caused misunderstandings or where not clear enough. “It was not elaborated enough how detailed budget items should be, so we used our own judgment; It would be good to adjust budget form to the specific media production costs, in order to make it clearer; It was not clear which costs go under which budget line. We were not able to fully understand the form without additional consultations with ISC staff; We were not sure whether honoraria for consultants we assigned for the project activities, should be placed in budget line no.2 or no 9, etc.” Exactly half of all respondents think that the budget instructions were Mostly Clear. In general, 88% of the respondents feel that the budget instruction were clear. However, some respondents had difficulties to clearly understand specific budget instructions: “It was mostly clear in general, but it was not clear and precisely defined what is air time, does it refer to TV advertisement only, or to general advertisement trough official channels, the usual channels of media communication; In the budget instructions it is asked for a reasonable ratio between administrative and program costs, and the preference will be given to those proposals that do not exceed 40% of administrative costs compared to program costs. It is not logical to have personal salaries as administrative costs. Not clear!!!-Confusing!!!; The ratio between project and non-project costs is not in accordance with the needs of the project, etc.

  21. Results Analysis Getting the word out: The ISC Serbia website, ISC mailing list and CDNPS mailing list seem to be the most valuable sources of information for CSOs interested in ISC/CSAI RFA, with 21%, 13% and 12% respectively. Receiving inputs from other CSO’s regarding funding opportunities seems to be another effective way of acquiring the appropriate information (17% of organizations stated that other organizations were their primary source). It is safe to assume that distribution channels amongst organizations which served as primary sources of information was similar to distribution amongst survey participants.

  22. Thank You

More Related