Virtually all evaluation guidance materials stress the need for good evaluation questions, yet the evaluation literature generally has provided only broad guidance on developing them. To help get to good questions–questions that are likely to lead to actionable evaluation findings–AaEA members Maureen Wilce and Sarah Gill created a checklist for use in assessing potential evaluation questions.
On the webinar, we’ll walk through the checklist and apply it to a variety of evaluation questions. Feel free to bring your own questions to the call or to send them in advance to sarahgill97 AT msn DOT com. If you can’t make the webinar, you can find the checklist at http://www.cdc.gov/asthma/
When: Thursday, November 14, 12-1
Where: Your desk
You may listen in on this webinar through either method:
1) Computer Audio: To use computer audio, you need speakers and microphone, or a headset.
2) Telephone conferencing
Toll-free: +1 (866) 916-1825
Participant code: 9114921
First Time Users: To save time before the meeting, use the link below to check your system to make sure it is ready to use Microsoft Office Live Meeting. It will prompt you to install a plug-in. https://www125.livemeeting.
AaEA invites you to join us for a 4 part course: Introduction to Program Evaluation.
Evaluation identifies, discovers, generates and displays information about an organization’s program efficiency and effectiveness. Evaluation reveals what a program really does, how it works, and it’s impact on people’s lives. Through lectures with noted evaluators and hands on application to a case study, course participants will learn the basic steps of a program evaluation.
Who Should Attend?
Anyone new to evaluation and interested in using it as a tool to support programs, whether as program staff or evaluators.
- Become familiar with the 6 steps of the CDC Evaluation Framework
- Learn to identify and engage stakeholders
- Develop a simple logic model and discover how to use a logic model to ask questions about your program
- Learn to focus your evaluation and to select appropriate data collection methods for your evaluation questions
- Understand how to transform data into useful information
Participants completing all 4 sessions will receive a certificate of attendance from AaEA
When and Where
Session 1 Wednesday, October 2 from 3-6 PM
Session 2 Wednesday, October 9 from 3-6 PM
Session 3 Wednesday, October 23 from 3-6 PM
Session 4 Wednesday, October 30 from 3-6 PM
At ICF International located at 3 Corporate Square, Suite 370, Atlanta, GA 30329.
AaEA members: The 4-session series is $20 ($15 for student members) and a single session costs $10.
Non-members: The series costs $60 ($40 for students) and includes a one year membership. A single session costs $25 ($15 for student). Not a member? Join now!
For more information, contact Travis Tatum at travis AT creativeresearchsolutions DOT com or Maureen Wilce at mwilce AT earthlink DOT net
You may always pay at the door with check or cash. Or you may pay with a credit card here but processing fee will apply.
Join AaAE, TEI, and ICF International for an evening panel with
Gary Henry, Mark Lipsey, and Ann Doucette on
Evaluation Methods and Theory: Addressing Real World Challenges
September 19th, 2013
6:00 – 8:00 PM*
Join us to hear from three evaluators whose contributions to our field are innumerable. Listen in as they discuss the challenges of moving evaluation theory and methods from the journals to the real world. Time permitting, we’ll open up the panel to Q&A from the audience to get additional perspectives on this important topic.
* Networking opportunity between 6-6:30 PM with the panel beginning at 6:30-8:00
Refreshments will be served throughout the event.
The event is free for AaEA members. Not a member yet? Just bring your checkbook, or $40, to the event ($25 for students). For non-members, the cost is $35.
ICF International is located at 3 Corporate Square, Suite 370, Atlanta, GA 30329.
More information about AaEA is available at www.atl-eval.org
For event or membership information, please contact sarahgill97 at msn.com
Non-members you may for this even via PayPal but processing fee will apply.
Implementing the propensity score matching method in evaluating public health programs: some practical guidance
When: Thursday August 22, 2013, 12pm est
Dr. Tursynbek Nurmagambetov, a health economist in CDC’s National Asthma Control Program, will provide an introduction to the propensity score matching method. Propensity score matching has recently become a popular approach in the evaluation of public health programs. It is an intuitive and straightforward method to reduce bias in evaluating the effects of a program using observational data. Tursynbek will also discuss some examples of economic evaluation studies using the propensity score method.
For more information, email mwilce at earthlink dot net.
Participant Entry Information
Meeting ID: PSTB3S
Toll free: +1 (866) 916-1825
Participant code: 9114921
An Evening with Stephanie Evergreen: Presenting Data Effectively: Practical Methods for Improving Evaluation Communication, 6/3/2013, 5:30
June 3, 2013
Reception 5:30 PM
Program 6:00 PM
3 Corporate Square, Suite #370, Atlanta, 30329
Crystal clear reports, slides, and graphs are valuable – they save an audience’s mental energies, keep a reader engaged, and make you look smart. In this meeting, Stephanie Evergreen will discuss the science behind presenting data effectively and will leave the audience with direct, pointed changes that can be immediately administered to their own conference presentations and other evaluation deliverables. The talk will touch on principles of data visualization, slideshow, and report design that support legibility, comprehension, and retention of our data in the minds of our clients. Grounded in visual processing theory, the principles will enhance attendees’ ability to communicate more effectively – the last frontier of evaluation use.
Stephanie Evergreen runs Evergreen Data, a data presentations consulting firm, and is the eLearning Initiatives Director for the American Evaluation Association (AEA). Her dissertation focused on the extent of cognition-based graphic design in evaluation reports. Evergreen is the founder and past chair of AEA’s Data Visualization and Reporting Topical Interest Group. She publishes a well-read blog at stephanieevergreen.com and her book Presenting Data Effectively will be published by Sage in Fall 2013
Following the event will be a catered reception for AaEA members. The event is free for AaEA members; $20 for non-members; $10 for students/interns/fellows. Not a member yet? Just bring your checkbook, or $40, to the event ($25 for students).
The event will be held at the *ICF offices at 3 Corporate Square, Suite #370, Atlanta, 30329. For more information about the event, contact Karen Anderson at kanderson2 AT familiesfirst DOT org or Maureen Wilce at mwilce AT earthlink DOT net.
Voices from the Next Generation: Insights on Evaluation from Georgia State Masters Students, 5/15/13 5:30
GSU AEA Event
May 15, 2013
Little Five Points Community Center
1083 Austin Ave NE, Atlanta, GA 30307
Join us as we welcome a new generation of evaluators into the field. Recent graduates from GSU’s School of Social Work will engage us in a conversation about their experiences in learning and conducting program evaluation. Students are required to take a course on program evaluation and technology in their second year, which includes conducting a program evaluation in the field. Dr. Mary Ohmer will give a brief overview of the course, which focuses on evaluation methods and approaches. Through an interactive panel discussion, students will share insights from the course and their evaluation projects, including how social service agencies are responding to and using evaluation. Jennifer Owens, MSW, who graduated several years ago, will discuss how she continues to use program evaluation in her work as the Manager of Community Partnerships with Columbia Residential, a local affordable housing developer. We’ll also discuss implications for the broader field of evaluation as we move further into the 21st century.
Types of evaluation projects conducted by student panel participants:
- A formative evaluation for Refugee Family Services Young Women’s Leadership Program
- A process evaluation for the Multi Agency Alliance for Children, Opportunity Passport Program for Youth
- A process evaluation for The Drake House Neighbor to Neighbor Program
- A formative evaluation for McIntosh Trail Community Service Board, Assertive Community Treatment program
- A process and outcome evaluation for the International Rescue Committee, Volunteer Program
Social time begins at 5:30 pm with the presentation following at 6:00 pm. The event is free to members and the public. AaEA annual membership is $40 ($25 for students/interns/fellows) and available for sign up at the door. For more information, contact Karen Anderson at kanderson2 AT familiesfirst DOT org or Maureen Wilce at mwilce AT earthlink DOT net.
Monday May 13, 5:30-7:00 PM
3 Corporate Square, Suite #370
Atlanta, GA 30329
Shelly Engleman and Tom McKlin from The Finding Group will share examples of their work using social network analysis (SNA). SNA has evolved as a powerful method for capturing both visual and mathematical elements of connections among people, organizations, and other interacting units. Evaluators use this method for mapping and measuring meaningful, often unseen, structural relationships in communities. This demonstration will introduce novice users to NodeXL, a free open-source template for Microsoft Excel, which can be used to prepare surveys to collect SNA-related data, organize data in NodeXL, and generate sociograms. Shelly and Tom will present two examples, the first examining how collaborations among high school computer science instructors have grown over time, and another looking at publication data to assess the partnerships among authors at a university research center.
About the presenters: Shelly Engelman, Ph.D. is a senior quantitative analyst at The Findings Group, an evaluation and grant-writing firm that serves K-16 public and private education organizations and programs. Shelly is a trained social and quantitative psychologist with an expertise in cultural diversity, gender, and racial disparities in academic achievement, and behavioral research methods. Tom McKlin, Ph.D., is president at The Findings Group. Tom has more than a decade of experience evaluating federal programs, serves on numerous federal proposal review panels, and serves as an invited guest lecturer on several evaluation topics.
Social time begins at 5:30 with the presentation following at 6:00 PM.
The event is free to members and $20 for non-members. Annual membership is $40 ($25 for students/interns/fellows) and is accepted at the door. For more information, contact Maureen Wilce at mwilce AT earthlink DOT net or Sarah Gill at sarahgill97 AT msn DOT com.
AaEA Webinar: Using the AEA Guiding Principles for Evaluators to Improve Your Practice, 4/30/13 12PM
When: April 30, 2013, 12:00 PM -1:00 PM EST
Where: Web-Audio Conference
Where: Space is limited to 50 ports, so please share lines where possible.
Join the webinar here and enter your email and company name upon entry. You can listen in using your computer headset. For interactive, two-way communication, dial in at Toll free: +1 (866) 916-1825 and enter participant code: 9114921#
This session is a follow up to the spring social in which we discussed the evaluation standards (from the Joint Committee on Standards for Educational Evaluation). The American Evaluation Association (AEA) Guiding Principles for Evaluators were developed to promote and guide the ethical practice of evaluation. This webinar will provide background and overview of the five overarching principles: systematic inquiry, competence, integrity/honesty, respect for people, and general and public welfare. Participants will have the opportunity to apply the Guiding Principles to a case study and consider how to use them when designing and conducting their own evaluations. Those planning to attend are encouraged to read the Guiding Principles prior to the webinar to ensure lively discussion. http://www.eval.org/publications/guidingprinciples.asp
About the presenter: Meredith Stocking is an Evaluation Fellow with the Centers for Disease Control’s (CDC) Air Pollution and Respiratory Health Branch. She has experience evaluating homelessness and rights-based development interventions serving vulnerable populations in multiple linguistic and cultural contexts. She received her Bachelor of Arts degree in International Relations from the University of San Diego and Master of Public Policy from the University of Minnesota.