Faculty Insight User Testing Group Report - Appendix A

Complete user feedback report, divided into three themes: Enhancement Requests, Education and Communication, and System Functionality. For Enhancement Requests, these themes are further organized into the following development areas: Dashboard Customization, Date Field Enhancement, Duplication of Records, and Filter or Category Options. The Actions/Next Steps column explains steps in progress to resolve the issue.

Enhancement Requests

Feedback from Survey	FI Tab/Section Comment Submitted on Form	Action/Next Steps
Service: It’s pretty common to be on a Committee on non-consecutive years, every other year, once every four, etc. It’s a little tedious and redundant to add a second entry for the same committee. Could there be an option to add non-consecutive dates into one entry?	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Doesn’t include date, only year. Had to go back and manually add the date, then had to rearrange in standard reverse chronological order.	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Degree: The required Received Date is cumbersome. It would be very helpful only have the year required and make the day and month optional.	Activities - Awards & Honors	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
As mentioned before, the report doesn't show the date of the activity only the year. Omitting the date is a fairly significant accuracy issue.	Activities - Awards & Honors	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
As mentioned before, the report doesn’t show the date of the activity only the year. Omitting the date is a fairly significant accuracy issue.	Activities - Career	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Professional Membership: Again, the date field (e.g., Start Date) is cumbersome. For Society Membership year-only should be an option; I picked a random, specific date. Also, this category should have an option for custom date ranges, e.g., “2004–2007, 2009”; otherwise, the entry would need to be duplicated, and it would appear multiple time in my profile.	Activities - Career	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Publication Date for Scholarship categories should have the option to include year only or year and month—otherwise the user is forced again to pick a random date.	Activities - Scholarship	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
When I self-enter an activity, such as a publication, I am prompted to enter the date of publication in the following format: mm/dd/yyyy. However, many publications do not specify such a specific date, with many simply indicating the year of publication or, in the case of journal issues, sometimes month and year or season and year. It would be useful to have an option to select which date format is appropriate for the given activity.	Activities - Scholarship	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
In Professional Service: Manuscript review in the sciences is common and expected professional service. It is cumbersome to deal with in FI. For any given Journal one might review a single or multiple manuscripts in a year, but not every year. Thus, e.g., 2017–ongoing does not work if the service did not happen every year. The only alternative is to add a record for every year when applicable. Again, in this case the option to duplicate an older record to just change the date is needed. Furthermore, I am not sure how to deal with noting that 1 or perhaps 10 manuscripts were reviewed for any given journal; as text in Description? Hopefully entry into Description will export in Reports. This information is needed for annual reports, program reviews, and promotion/tenure decisions.	Activities - Service	The ability to copy an existing record has been added to the tool by AcA. Date field requirement challenges have been shared with the AcA team and will require further exploration. Text entered into the Description field will export to the Promotion & Tenure report, but is not currently exporting to the Annual report. We are working with AcA so this information will also be included in the Annual report.
It’s pretty common to be on a Committee on non-consecutive years, every other year, once every four, etc. It’s a little tedious and redundant to add a second entry for the same committee. Could there be an option to add non-consecutive dates into one entry?	Activities - Service	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Do we have to have dates in mm/dd/year. Lots of things I would like to just have year format or month/year. Especially since it reports out in export with just the year.	Activities - Service	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
On dissertations, start date is required rather than end date. End date is easy to track, but start date can be hard to get, particularly historically.	Activities - Teaching & Mentoring	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Problems with updating dates- often given errors, especially with grants- tried different formats (month, day and year; month and year).	“Please enter any additional comments below.”	This feedback has been shared with AcA. If an error message is received, please contact aire-help@ku.edu or AcA through the Get Help icon in Faculty Insight.
Could we have the start date default to the end date for 10+ year old items that only have one date? This has taken me a long time to update on very old service activities.	“Please enter any additional comments below.”	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
I found the mentoring section not very usable because there I didn’t see a place for a general narrative description for mentoring. It required a date entry for each example of mentoring which is impossible for me. I have students pop into my office often for mentoring and I don’t document the date anywhere. For appointments that I set up with students, getting the accurate details that I’d need to fill out the form would mean combing through my Outlook calendar for the past 3 years and trying to reconstruct all of the student meetings and what mentoring took place.	Activities: Teaching & Mentoring	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
It would be great to have a “Duplicate” feature to copy one entry, such as a professional experience entry, to start another. This is true to all/most sections.	Activities - Awards & Honors	The ability to duplicate and then edit an existing record has been added by AcA.
Professional Experience: It should be possible to duplicate a record to upon promotion, e.g., be able to duplicate the Assistant Professor entry to only have to change it to Associate Professor.	Activities - Career	The ability to duplicate and then edit an existing record has been added by AcA.
While the interface is intuitive, a lot of manual entry is required in certain sections. Introducing a copy or duplicate function would help streamline the process and reduce self-entry time, especially when only minor edits like updating dates or titles are needed.	Activities - Career	The ability to duplicate and then edit an existing record has been added by AcA.
The previous software before FI used to offer a way to duplicate entries so that we only had to modify a few details if we repeatedly published in the same journal, indicating that such an option, when given available, would much increase the usability and user-friendliness.	Activities - Scholarship	The ability to duplicate and then edit an existing record has been added by AcA.
Options to duplicate entries should be available throughout, e.g., in Presentations.	Activities - Scholarship	The ability to duplicate and then edit an existing record has been added by AcA.
Copy/duplicate function would have been very helpful. I have severed on many committees on and off in my careers and would be nice to have to function where I just change dates or my role (member vs chair)	Activities - Service	The ability to duplicate and then edit an existing record has been added by AcA.
It looks a little busy. Can individuals customize the dashboard to pin specific items of interest?	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Would it ever be possible to customize the homepage with features each person wants?	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
I found it helpful that Home presents a set of important information, but I wonder whether there may be a way to personalize it, e.g., selecting types of information that we want to have. Currently, not all types of information is necessary, and the interface looks a little overwhelming.	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Once my profile was updated, I appreciated the home screen’s features, such as suggested funding opportunities and recent works. One improvement that could enhance usability is the ability to rearrange the home screen, allowing users to prioritize and place the most relevant items higher up for easier access.	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
In Manage Your Records Search - Filtering function in record search is difficult to use. Would be useful to be able to filter by date, status, type, not just visibility.	Home
In Filters, it would be helpful to add more criteria, e.g., Type of Recognition or Year?	Activities - Awards & Honors	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Again, export of, e.g., all entries from within each Service category would be extremely helpful to be able to see at a glance what data is missing or needs to be updated for any of the entries. Filtering by year for these exports would be preferred.	Activities - Service	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Would be nice to filter by School/University/Department.	Activities - Service	Professional Service and University Service are sorted in the CV-style reports with subheaders: Professional Service is sorted by scope and University Service is sorted by ‘level’ i.e. Dept, School, Unit, etc. Additional discussions on customizations between AcA and KU are needed.
It would be nice if one could sort or filter by the categories that are displayed (such as current status on grants).	"Please enter any additional comments below."	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Would be great to be able to create categories of service. I have many types of professional and university service, and seeing them all as a list without categories is very hard to see what is missing.	Activities - Service	This feedback has been shared with AcA. Additional discussions on customizations between AcA and KU are needed.
It would be helpful if in Professional Service Position / Role were a pull-down list (including, e.g., member, chair, etc.) (also applies to University Service).	Activities - Service	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
Professional Service does not allow to indicate whether the role was appointed or elected. (also applies to University Service).	Activities - Service	This feedback has been shared with AcA. Additional discussions on customizations between AcA and KU are needed.
Add Position / Role to the Manage your Records table in Professional Service. (also applies to University Service).	Activities - Service	This feedback has been shared with AcA and is in progress.
There is no separate category for postdoctoral scholars in Student Level in Student Mentoring. This would be the only place for postdoctoral scholars, keeping in mind that they are NOT students.	Activities - Teaching & Mentoring	This feedback has been shared with AcA and further conversations will take place to find a potential resolution.
When entering information for Student Advisors, it feels redundant to manually input the Student Institution. It would be much more efficient to have a simple checkbox for “KU Student” that automatically fills in the institution.	Activities - Teaching & Mentoring	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
I suggest adding a new option to the “work review status” drop-down menu: “Law review/law journal article.”	Activities - Scholarship	This feedback has been shared with AcA and further conversations will take place to find a potential resolution.

Education and Communication

Feedback from Survey	FI Tab/Section Comment Submitted on Form	Action/Next Steps
The terminology on the site could be clearer. Activities is a broad term that is not necessarily intuitive to click on. Has there even been consideration of breaking activities out into the three components main components for faculty areas of responsibilities: teaching/professional performance, service and research?	Home	This feedback has been shared with AcA. In-tool term definitions are in the process of being added.
It’s pretty arduous as a new user to add entries for your entire career. This is likely the biggest barrier to entry for most faculty.	Home	This feedback has been shared with AcA. Department personnel can be designated as a proxy user to aid in record entry.
I think it would be very helpful if the University made a youtube tutorial, perhaps one for a general area of disciplines (creative disciplines, humanities, sciences, etc)that could be shared. Also, perhaps an FAQ based on some of the common issues you are identifying through this survey.	Home	AcA has recently added some video tutorials to their Help documentation. OFA/AIRE will review to see if additional videos are needed.
Awards vs grants? (LA Fund)	Home	Discussions for clarifying the two terms are in progress.
If you don’t tag performances correctly, they don’t show up in report.	Home	For performances to appear in the P&T report, they will need to be labeled major/minor.
I continue to be mystified by the Recently Matched Works, Upcoming Deadlines, and Recent Collaborator Works sections. It is not intuitive what these are for when first accessing the site. The Check My Profile link for each does not help. Perhaps this will become more clear once I have added more data?	Home	This feedback has been shared with AcA. AIRE is creating additional resource materials to provide category explanations.
For architecture fields, many of our standard venues for publication do not appear to be part of the Academic Analytics databases, requiring that most entries must be done manually.	Home	This feedback has been shared with AcA, and faculty are encouraged to reach out to them with inquiries regarding imported records. However, some manual entry may always be needed.
I’m unsure how to list an exhibition catalog, which is a publication that would accompany an exhibition. The closest I found was “Other Publications” but within this field there isn’t a category for Publisher.	Home	Faculty Insight does not currently have a dedicated section for exhibition catalog, however these can go into works/interviews, other, or another category as agreed upon by your department.
Uncertain how to document a research activity that has multiple components that fit under multiple categories. For example last year I organized a symposium at KU that involved a lecture series, an exhibition (of both external and student work), a reading group and a series of field trips.	Home	Faculty should consult with their department policy or leadership for guidance on how to enter multi-component works.
Grants are nested under “Scholarship” Shouldn’t this be under “Awards and Honors”? In our field grants and funding are more likely to support Creative Works, so it doesn’t make sense for this to just be under “Scholarship.”	Home	In tool definitions to better explain categories are in progress.
Under “University Service” it’s redundant to have to list the institution since it can only be KU.	Home	University Service can hold records at KU where service is done or at previous institutions.
Not sure about Primary Role for music performances. What is meant by Sponsor?	Home
Correcting issues with 20 years of past data is rough. I would recommend the “Update your activities” focus on the most recent errors first, otherwise one gets bogged down in 2004 dissertation committees and service. I would also recommend having faculty focus on updating the last 5 years rather than the full record to start with.	Home	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
There does not seem to be any location to add a professional license to the record. This is extremely important for academics in professional fields.	My Profile	Faculty Insight has a section for professional licenses in the ‘Career’ heading called “Licenses & Certifications”
It is unexpected that the My Profile link in the menu bar takes me to Works in My Profile rather than the first item in the My Profile menu bar, i.e., Research Profile.	My Profile	This feedback has been shared with AcA. AIRE is creating additional resource materials to provide additional category explanations.
There were many missing items at the start. Some dates were wrong.	My Profile	If your record seems inaccurate or to be missing items, please reach out to aire-help@ku.edu or to AcA through the Get Help icon in the tool.
Can the User Interface look like a CV? The long list of items, sorted by year and split across multiple pages, is really hard to review for accuracy. Things also don’t look like CV entries, so I have to click through to check things for accuracy. It would be great to just see the entry, in full, like a CV.	My Profile	To view how items appear in a CV format, you can download the ‘annual review report,’ although this won’t include every single field within the system.
Making the GUI look like a CV would also, I presume, allow me to sort entries in a manner that is intuitive. My CV isn’t, for example, just “all service, sorted by year”. My CV is sorted by type of service (KU, international, etc.), then by organization, then by role (chair, secretary, member, etc.), and then by year. That structure makes the information digestible. I’m sure this looks different in different academic fields, but I need a CV sorted this way for my professional work. Fwiw, the reporting function spits out a CV that is a lot like mine, and much easier to understand than the website (though still not sorted the way I need).	My Profile	This feedback has been shared with AcA. Further assessment will take place to determine wide spread impact and feasibility of system changes.
“Research Statement” and “Research Summary” seem redundant to me. Also, for a performer, a bio is like a research statement so I have redundant information in all three fields of my profile.	My Profile	AIRE and AcA are considering adding informational icons to fields.
When we edit our profile (not under ‘My Profile’ but profile in general), a large image file may not be accepted, but there is no clear guideline about the file specifics.	My Profile	AcA will add this to their Help documentation.
There is a bit of confusion when you select “Works” and click on an entry, it shows editable data fields. However, when I was first using this, I discovered many entries that were incorrect (those imported from the previous service). After editing and saving my corrections. I would later log in to find that none of my changes were there. I inquired about this and was told that this happens and it was suggested to only make edits in the “Activity Manager” This is very confusing	My Profile	One should be able to edit records in the My Profile tab. It is always possible that not all required fields were filled causing a record to not save. The My Profile tab will not display collaborator info either, making it unclear if this is causing errors when saving updates here.
I would expect to see all of the editable information here from the “Edit profile” section (bio, research summary, teaching, research, and service statements-if provided).	My Profile	My Profile
It would be nice to have a quick link to edit my Research Summary and Research Interests from this page, or instructions on where to go to do that. I thought that I could edit it within “Activities,” but I don’t see a place to do that.	My Profile	These are edited in the ‘edit profile’ section. This feedback has been shared with AcA.
The concept of Community-engaged activity? is unclear. Perhaps give an example of what you expect here?	Activities - Awards & Honors	OFA and AIRE met with Office of Community Impact to determine a holistic definition of community engaged scholarship. This Community-engaged activity is not defined. Activities - Awards & Honors definition will soon be added by AcA once finalized.
Community-engaged activity is not defined.	Activities - Awards & Honors	OFA and AIRE met with Office of Community Impact to determine a holistic definition of community engaged scholarship. This definition will soon be added by AcA once finalized.
Same comments as previous tabs about accuracy and usability. Would be much easier if the GUI looked like a CV.	Activities - Awards & Honors	This feedback has been shared with AcA. Further exploration is needed. To view how items appear in a CV format, you can download the ‘annual review report,’ although this won’t include every single field within the system.
Wonder whether the information about research grants would also be saved under this tab.	Activities - Awards & Honors	In tool definitions to better explain categories are in progress.
I received the “Unable to create record” error after having spent 15 to 30 minutes on entering the data for a more complex entry. Very discouraging	Activities - Awards & Honors	There could be a variety of things causing this (e.g. not all required f ields are filled in, too much text in a field) and this can create an error when creating the record. Reach out to AIRE-help@ku.edu if the problem persists.
Perhaps each discipline or department/program needs to decide how to interpret some of these categories.	Activities - Awards & Honors	When not defined in the system, faculty members should enter and interpret categories based on their unit policies and guidance.
The sections between professional performance and professional experience were difficult to understand (also see accuracy). You may want to talk to others with these job. I did not really understand the difference- was it for previous employment?	Activities - Career	The Professional Performance section is specific to Libraries and used in the P&T report. OFA and AIRE will consult with AcA to provide an information icon to add clarification.
Degree: What is meant by Location of Institution (country, city)? Guidance would be helpful for standardization across individuals in the system.	Activities - Career	Will assess whether an informational icon will be helpful to provide more clarity
Professional Experience: The category of Related to PK-12 Teaching or Administration seems way to specific for use across disciplines. I need an explanation.	Activities - Career	This checkbox is used for CAEP accreditation reporting. However, this is an optional field and can be left blank if not applicable to an activity.
References to My Work/Interviews: Not sure how this section fits into Career. In the sciences, interviews and mention of research falls in the Service category. The number of citations from Google Scholar or other source, or h-index would be a more appropriate metric here.	Activities - Career	Please refer to unit policy and expectations for best placement.
I was confused about where to enter roles such as “Honors Faculty Fellow” or “Digital Humanities Fellow.” I chose “Professional Experience,” but they are not “jobs” at KU per se	Activities - Career	Please refer to unit policy and expectations for best placement.
Only included my appointments at assistant a full- not my associate appointment. For some reason, my associate appointment showed up in my professional performance section.	Activities - Career	Please reach out to aire-help@ ku.edu or to AcA through the Get Help icon within the tool.
Can media interviews be included under a different section? Perhaps create a separate section for media interviews and other items related to public affairs/relations?	Activities - Career	The interview section is categorized across all universities who use Faculty Insight. This feedback has been provided to AcA
Reference to my work/Interviews – should be separated in my opinion. I had an article about me that was in journal section – would be nice if there was a move function.	Activities - Career	The interview section is categorized across all universities who use Faculty Insight. This feedback has been provided to AcA.
Do the entries under professional membership help with matches for potential awards?	Activities - Career	No, they do not
For the P&T document -Licensure and Certifications do not show up. They do however show up in the annual report.	Activities - Career	This is not currently in approved P&T CV format. This change would need to be considered and approved by all parties.
It is not clear why the section “Bibliographic References to My Work” is located between “Minor Publications or Creative Works” and “Scholarly Presentations”. It seems to me that references to one’s work should occur after one’s own contributions, i.e. this section should not come before Scholarly Presentations. This is especially true if one or more of the references are to works such as presentations or keynotes.	Activities - Career	This will be reviewed for a potential update.
Under the professional performance tab, it does not seem to allow for much formatting. Also, the directions about the line for those responsibilities held before their last promotion seem a little out of context. Is the goal to keep a historical record of responsibilities? I am not sure if is necessary since each entry should be separate for different roles.	Activities - Career	r AIRE and OFA will access how clarity can be improved, given the limited formatting options of the system
Same comments as previous tabs about accuracy and usability. Would be much easier if the GUI looked like a CV.	Activities - Career	This feedback has been shared with AcA. Further exploration is needed. To view how items appear in a CV format, you can download the ‘annual review report,’ although this won’t include every single field within the system
I think some things will be department / School specific where to record things (e.g. professional development)	Activities - Career	This is correct
Easy to use for creative work that fits into the provided categories, but difficult to navigate when exhibitions or creative works have multiple components with different dates and modalities.	Activities - Creative Works	There are different approaches and ultimately department level guidance could be provided for this.
What about grants funded for creative works? Should they be entered under Scholarship	Activities - Creative Works	Questions on this can be referred to department leadership for clarification
It’s odd which inputted information appears in the report and which is omitted. I mentioned the issue with dates being omitted. Also, several activities didn’t appear on the report at all even though I inputted them. That necessitates the extra step of going back to check which activities are missing and adding those manually	Activities - Creative Works	This may have to do with the P&T report, which requires major/ minor status to be filled in for scholarship records to appear. It also does not include certain items like Prof Dev. Would need more info to look into specifics
The primary distinguishing factor in determining the significance of an exhibition in the field of Visual Arts is defining whether the creative work is part of a Solo or Two-Person Exhibition or a Group Exhibition. Solo exhibitions are much more prestigious and significant, whereas group shows are treated as less prestigious in general. There is no way to indicate this on Faculty Insight other than in the description.	Activities - Creative Works	Solo/Group was added recently as part of a discussion around the P&T report.
A colleague has publications with a coauthor affiliated with a university in another country, which does not come up when entering their affiliation. When they write the affiliation manually (instead of selecting from a list), it caused the paper to not get saved on the system, so they in the end had to enter this publication without the coauthor’s affiliation. We would like know whether this issue could be solved, as many of us collaborate and co-publish our research with international scholars, whose affiliation may be out of the list from which we select inside the FI interface.	Activities - Scholarship	This feedback has been shared with AcA. When an error in saving occurs, please reach out to airehelp@ku.edu or to Academic Analytics through the Get Help icon in the tool. This will enable us to examine the exact issue.
The publication auto-population feature is very helpful, but there seems to be variable time lag between the point of publication and the point of auto-population. For those who prefer to selfenter and record all the progress statuses, it would be helpful to know a little more about when the published item would be populated from outside publication source/records, to make it more handy to manage entry duplication.	Activities - Scholarship	Recently Matched Works are highlighted on the homepage to help notify the scholar when new works are matched to their profile. Generally, articles, conference proceedings, and clinical trials are updated monthly; books, book chapters, and grants are updated weekly and monthly (depending on the source); awards are updated daily; and patents are updated twice yearly. See Faculty Insight Information Guide for more details.
In Book Chapters, in AcA entries, I am very confused about the Add Collaborators section. The user (i.e., me in this case) is listed as a collaborator. Intuitively, this should be a list of individuals other than myself! (see earlier for comments on the drawbacks of not having an Author(s) field)	Activities - Scholarship	The author will be displayed in the Collaborators box so that additional information can be gathered (author order, role, etc). Perhaps confusion on the naming of the “Collaborators” section (as faculty author is not technically a collaborator) but this is the section for all author info including faculty author info.
In Book Chapters, in AcA entries, I am very confused about the Add Collaborators section. The user (i.e., me in this case) is listed as a collaborator. Intuitively, this should be a list of individuals other than myself! (see earlier for comments on the drawbacks of not having an Author(s) field)	Activities - Scholarship	AACSB is accreditation for Business, it has been requested to AcA to have these fields only visible to relevant unit, currently they are visible across university. Further discussion with AcA is in progress.
I’m unsure how to list an exhibition catalog, which is a publication that can accompany an exhibition. They are typically a more prestigious research outcome. They aren’t exactly “Books” since they are not themselves the primary creative or scholarly product, they aren’t really reviews. These are very common in the field of Visual Arts.	Activities - Scholarship	AIRE has been entering these in References to my Work/Interviews section in Faculty Insight, but unit could choose to enter these where they see is appropriate
“Conference Proceedings” and “Presentations” were used interchangeably previously, so I made the decision to keep them all under one heading.	Activities - Scholarship	When not defined in the system, faculty members should enter and interpret categories based on their unit policies and guidance
I don’t see a category for Op-Eds or other media pieces.	Activities - Scholarship	An op-ed written by a faculty person could go into Other Publications, unless they felt a different category was a better f it. Enter and interpret categories based on unit policies and guidance.
On the research side, I saw no place to document f ield research, which for some of us is very timeconsuming and requires securing grant funds.	Activities - Scholarship	Field research is not a specific category in Faculty Insight as this time. Discussions with AcA are in progress.
In Book Chapters, in AcA entries, the publisher is abbreviated (e.g. “CRC Pr I Llc” instead of the complete name)	Activities - Scholarship	AcA strictly follows bibliographic citation styles. Please contact them through the Get Help icon with questions or concerns.
In Grants – Funded, there is an issue with duplicated entries from FITC and AcA.	Activities - Scholarship	This feedback has been shared with AcA. Further exploration is needed.
In Grants – Proposal, why do Streamlyne entries of funded grants appear here?	Activities - Scholarship	Please reach out to aire-help@ ku.edu and AIRE can gather additional details and provide guidance.
In Journal Articles, the word “Abstract” is imported with the abstract in some AcA entries.	Activities - Scholarship	Data from journal articles is directly imported from Baker and Taylor or Crossref. We will look into this further.
In Journal Articles, individual publications are not captured by AcA even though others (even earlier ones) from the same journal are.	Activities - Scholarship	For missing records, please reach out to airehelp@ku.edu, or directly to Academic Analytics through the Get Help icon in the tool.
Grants are nested under “Scholarship” Shouldn’t this be under “Awards and Honors”? In the field of Visual Arts, grants and funding are more likely to support Creative Works, so it doesn’t make sense for this to just be under “Scholarship”	Activities - Scholarship	Grants are automatically imported into this section and are unable to be imported to other sections, however, we recognize that some units may categorize these differently and could manually input these items into another category if they choose.
Some minor publications were listed under Journal Articles, while others were in Other Publications. It would be helpful to have a move function to ensure items are organized in the appropriate section. Additionally, incorporating a multi-select delete option would allow users to efficiently remove multiple items at once if they are in the wrong section	Activities - Scholarship	Due to differences in fields between activity types, move functions cannot be offered.
It would be helpful to define what should be included in the sections, for example, “Other Publications” would be magazine or blog article? not peer-reviewed?	Activities - Scholarship	AIRE and AcA are working together to add in-tool definitions and explanations.
Streamlyne--the amount is $0 and the other is the funded amount of $36,260. Is this trying to indicate grant applied for vs grant received?	Activities - Scholarship	Please reach out to aire-help@ ku.edu and we, so more specific details of the issue may be gathered.
How do we “report issue” on Streamlyne data (I have an old proposal listed as “in preparation” rather than “not funded”.)	Activities - Scholarship	At this time, please reach out to aire-help@ku.edu so more specific details of the issue may be gathered.
When I first printed out a P&T/Annual report document, only stuff prior to 2018 printed out on the documents under major publications. Had to make sure all works were classified as Major from 2018 on to print out	Activities - Scholarship	The P&T report requires major/ minor to be selected for records to appear, this is not necessary for the annual review report.
I have served as an editor for seven journal issues, curating the work and soliciting authors, etc. However, it is not clear where such efforts should go within the Faculty Insight tool.	Activities - Scholarship	Internal discussions to have Funded Streamlyne data removed are in progress.
I think you should be able to delete a record not just hide it. This is especially important for those of us who had records imported from the previous system.	Activities - Scholarship	Records imported from DM/PRO or that are self-entered can be deleted. Records imported from AcA or from current KU databases (DSL, Grants, Courses Taught, etc.) can not be deleted.
With regards to grants, the site should clearly explain which grant information will be automatically curated from KUCR or other sources.	Activities - Scholarship	In-tool definitions and explanations are in the process of being identified and added.
Same comments as previous tabs about accuracy and usability. Would be much easier if the GUI looked like a CV.	Activities - Scholarship	This feedback has been shared with AcA. To view how items appear in a CV format, you can download the ‘annual review report’, although this won’t include every single field within the system.
This tab is the most difficult of them all for me. I have so many works (~225 in 12 years) that it’s difficulty to see what’s there and what is missing, and it’s difficult to add the missing things.	Activities - Scholarship	We recommend downloading the appropriate CV-report and reviewing works in that format. AIRE is also working to produce new reference materials to provide guidance on topics such as this.
Some confusion on - Poster Presentations vs published abstract. Do we put it in poster presentation and Journal article since it is published abstract but label the abstract minor. copy function would be nice for things with same title/authors	Activities - Scholarship	Please reach out to aire-help@ ku.edu so additional details about your work can be gathered to appropriately provide guidance. The functionality to copy and paste existing records has recently been added by AcA.
Also what would be “reviews”? When you review an article or if a review article is written (which the latter would be under “Journal Articles”).	Activities - Scholarship	The Reviews category is meant for reviews such as book reviews, written by faculty. If someone else authors an article about faculty, that would go into References to my Work/Interviews.
To ensure accuracy of self-entered activities from years ago, I discovered that it is important to go back in and provide end dates for activities that were once “ongoing.” Is there a better fix for this? (I need to cleanup this section further and remove duplicates.)	Activities - Scholarship	Updating self-entered works from ongoing to current status would need to be done manually. We will look into an educational resource on this.
Under “University Service” it’s redundant to have to list the institution since it can only be KU	Activities - Service	University Service holds records from both KU and from other institutions, and selecting the institution from the dropdown will help differentiate that in reporting.
Did not like that I had to enter “University of Kansas” for each entry under institution. Would be nice if it was auto populated or there was checkmark for University of Kansas.	Activities - Service	This feedback has been shared with AcA. Further exploration is needed.
Might there be suggestions for word to use for “Position/Role”? I started using old terms from Academic Analytics.	Activities - Service	AIRE is developing additional resources, and in-tool definitions and explanations are in the process of being identified and added.
I would like guidance on if I should keep all of these on my record- some go back 16 years.	Activities - Service	AIRE recommends creating a complete record as possible, but guidance may also be needed at the unit level.
In service, I would encourage making scope/ impact required. I think it would really help us in thinking about service more.	Activities - Service	This feedback has been shared with AcA. Further exploration is needed.
Annual reports for units at KU are due in January, yet, none of the 2024 information for any of the categories was available in the system early in January 2025. This information should be available by year’s end! (Update, it became available around Jan 08).	Activities - Teaching & Mentoring	This feedback has been shared with AcA. AIRE will further explore with AcA.
Advising and mentoring work with graduate students is difficult to document here when it isn’t formally reported by Grad Studies. I did not see a place to enter teaching-related talks or other professional work related to teaching.	Activities - Teaching & Mentoring	Teaching related talks could go into Presentations or Service. Please seek additional guidance from unit leadership
Student mentoring, has my APPE rotations (PHPR 601-609). I didn’t delete for now and didn’t manually enter missing one. Need to figure out a place for them.	Activities - Teaching & Mentoring	New category “Courses Taught Summary” could potentially be a place for this. Student Mentoring section will have any records transferred from DM that were entered as either DSL or mentoring/advising.

My department usually tracks a numeric on student evaluations for courses taught. There doesn’t seem to be any place to add any sort of assessment of teaching.	Activities - Teaching & Mentoring	This feedback has been shared with Academic Analytics. Additional exploration is needed.
Course with multiple sections (Lawrence and Wichita) are listed twice and then if there are discussion sections, these are listed also. For 1 class, it may should up 5 times. On export my classes took up 8 pages.	Activities - Teaching & Mentoring	This information is likely imported from Enroll & Pay in this format. AIRE will work with AcA to explore solutions.
Does % taught need to have 2 decimal points?	Activities - Teaching & Mentoring	% Taught is used for P&T report. Faculty Affairs and AIRE will explore if 2 decimal places are necessary and report back to AcA
Guest teaching should ostensibly belong under teaching but there is not a way to added guest artist classes in this section.	Activities - Teaching & Mentoring	There are a few different ways to enter this. A new category called Courses Taught Summary could be appropriate here. Also, if it is a job, it could go into Prof Exp. If this is a guest classroom presentation for someone else’s course, it could go into Presentations.
It is not entirely clear what information needs to be entered under ‘Student Achievement’ category and ‘Student Mentoring’ category.	Activities - Teaching & Mentoring	AIRE is developing additional resources, and in-tool definitions and explanations are in the process of being identified and added.
Where can you add other teaching - such as certificate programs, etc.. Would this just be listed under presentations. Same as a guest lecture for a class?	Activities - Teaching & Mentoring	A new category called Courses Taught Summary could be appropriate here. Also, if it is a job, it could go into Prof Exp. If this is a guest classroom presentation for someone else’s course, it could go into Presentations.
Just need reminders to populate annually!	Activities - Teaching & Mentoring	AIRE and the Faculty Affairs are developing new resource materials and communication plans to assist with this.
For “Student Achievements,” is this for when a student wins an award such as a Fulbright? I thought I had entered this for one student, but it isn’t appearing.	Activities - Teaching & Mentoring	Yes, this category is used for achievements of current and former students. Please reach out to aire-help@ku.edu so more specific details of the issue may be gathered.
Should thesis/dissertation committees be in directed student learning and student mentoring? The former is more accurate, but goes back to 2011 while all other committees appear to be under student mentoring (current committees that haven’t defended, duplication, and committees prior to 2011, I have 7 full pages to work through).	Activities - Teaching & Mentoring	Thesis/dissertation committees at KU should theoretically be imported into DSL. However, it was previously self-entered, so sometimes there are duplicates now between these two sections. Please reach out to airehelp@ku.edu or to AcA through the Get Help icon in the tool if you need more assistance.
The main page of this Tab was confusing to me. Consider changing the wording.	Reporting	This may have to do with the P&T report requiring major/minor to be selected for pubs to appear. AIRE and OFA will explore this must be required in order for accurate reporting.
It did not include publications even though the “exclude from CV” option was not checked.	Reporting	This feedback has been shared with AcA. Additional exploration is needed.
On our end, there are three formats of reports (CVs) available for selecting. We wonder whether there may be a way to generate a CV in a generic format besides those three.	Reporting	We recommend exploring the ‘Create New’ function in the Vitas/ Biosketches area of Reporting.
It would be tremendously valuable to be able to know explicitly which fields are displayed in each report. This would help focus efforts about which f ields should/could be filled to maximize utility to use existing field more effectively for annual reports, program reviews, and promotion/tenure decisions.	Reporting	This feedback has been shared with AcA. Additional exploration is needed. AIRE is also developing new resource materials.
I worry that if the department pulls an annual report, that it will not be accurate unless each faculty member is vigilant in checking the reporting output in addition to updating records. Do these small differences impact other reporting mechanisms?	Reporting	The only reports impacted are those created within Faculty Insight. Please reach out to airehelp@ku.edu if you would like to discuss further.
I like the option to build a new Vita, but this is not apparent on the main page of this “Reporting” Tab	Reporting	This option is available in the ‘Create New’ function in the Vitas/ Biosketches area of Reporting. This feedback has been shared with AcA on placement.
Clear step-by-step written guidelines	Based on your experience updating your profile, what type of support and resources do you feel would be helpful to faculty in updating their profiles and using Faculty Insight to manage their activities?	AIRE is working on additional resource material for their website. This will try to be incorporated.
Having a video tutorial to share with faculty would be very helpful.	Based on your experience updating your profile, what type of support and resources do you feel would be helpful to faculty in updating their profiles and using Faculty Insight to manage their activities?	A collection of video tutorials have been added to AcA Help documentation.
The overview videos are very helpful, however, the description of some of the entries profile page (dropdown format) would be helpful in guiding for providing relevant information.	Based on your experience updating your profile, what type of support and resources do you feel would be helpful to faculty in updating their profiles and using Faculty Insight to manage their activities?	AIRE is developing additional resource material for their website.
Regular reminders to update activities (maybe once per semester). Could have quarterly “write-ins” where time could be dedicated to updating these profiles (with snacks ;) ) to incise folks to utilize the time dedicated. Also to express the importance and utility of the tool. Many faculty I have spoken to are not aware of the tool, the exchange from PRO, nor the ease of reporting that can be gained once the data is in place.	Based on your experience updating your profile, what type of support and resources do you feel would be helpful to faculty in updating their profiles and using Faculty Insight to manage their activities?	AIRE and the Office of Faculty Affairs are developing new resource materials. These are also great ideas that could be supplemented by unit leadership.
I think options for a hands-on workshop within a department with assistance on hand from those familiar with FI could be beneficial. This could be expanded to include multiple departments with similar types of research. You could have one event for the humanities, one for social sciences, and one for interdisciplinary and international, etc. What incentives are out there for faculty to put in the many hours that are needed to update their profile by logging their activities?	Based on your experience updating your profile, what type of support and resources do you feel would be helpful to faculty in updating their profiles and using Faculty Insight to manage their activities?	AIRE and the Office of Faculty Affairs will explore options for Faculty Insight working sessions and incentives.
Research Keywords - the imported AcA has lots of abbreviations. Would love to be able to delete.	“Please enter any additional comments below.”	AcA imported “Research Keywords” can be removed in the Edit Profile section.
Can you have an option for one-time funding? Especially for internal funding.	“Please enter any additional comments below.”	Internal grants can be entered by selecting ‘internal’ from the ‘Funding Source’ dropdown. Only start date is required in grants categories, it does not have to be a date range
After a somewhat steep learning curve, it was relatively easy to use the system. I still find it a bit clunky in places, and it seems geared toward science or business fields far from my areas of expertise. I would have liked to see info/pop-up boxes to provide me with more guidance and details. For instance, what does “Add to KU Web Profile” mean exactly?	“Please enter any additional comments below.”	In-tool definitions and explanations are in the process of being identified and added.
It was very time consuming to update. Is there a way to upload a current CV and have the information in it populate Faculty Insights?	Feedback on the Tool as a Whole	This functionality is on Academic Analytics roadmap.
Good. I am unclear what would fall under the “Professional Development” category.	Activities: Career	These activities could include continuing education or other time spent further developing your professional knowledge.
Many items under Suggested Funding are not relevant for my research. How is the Suggested Funding information curated?	My Profile	Opportunities are identified by indexing the funding database against the scholar’s research terms. Research terms are identified in activities from all source types (self-entered, imported, or from AcA) and must be marked as visible to the ‘Public’. Research terms will also include the person’s research interests from their profile. Keywords can be edited by the faculty member within Edit Profile.

System Funtionality

Feedback from Survey	FI Tab/Section Comment Submitted on Form	Action/Next Steps
Many items under Suggested Funding are not relevant for my research. How is the Suggested Funding information curated?	My Profile	Opportunities are identified by indexing the funding database against the scholar’s research terms. Research terms are identified in activities from all source types (self-entered, imported, or from AcA) and must be marked as visible to the ‘Public’. Research terms will also include the person’s research interests from their profile. Keywords can be edited by the faculty member within Edit Profile.
Overall, it would be helpful to separate the tab containing info from my profile (e.g., Works, Timeline, Course), from those that display aggregated data, new data compiled from FI based on my profile.	My Profile	For performances to appear in the P&T report, they will need to be labeled major/minor.
I found it helpful that Home presents a set of important information, but I wonder whether there may be a way to personalize it, e.g., selecting types of information that we want to have. Currently, not all types of information is necessary, and the interface looks a little overwhelming.	Home	In the future AcA hopes to make the Home page customizable by faculty members and/or the institution.
For some of the tabs (e.g., Suggested Funding and Suggested Awards), it would be helpful to include a brief description of which data sources are used.	My Profile	This information is included in AcA Help documentation.
The term Works seems odd since it is unclear. Is this a compilation of categories of Activities?	My Profile	Yes, Works tab is a compilation of activities.
Timeline: It would be helpful to have a heading stating what data is included in the timeline.	My Profile	This feedback has been shared with AcA. Additional discussion is needed.
Consider consistency: In Related Terms and People, the categories displayed are Research Keywords and Related Scholars, while the terms in the download tab are Related Terms and Similar Scholars. And given the formatting of the Research Keywords/Related Terms, the downloaded list is not terribly helpful. Similar Scholars download as a list with the column heading of DepartmentName 1 and ProgramName 1. The “1” does not mean anything to the user at this point; it obviously refers to the field names in FI, although in My Profile, my data refers to Department Affiliations and Program Affiliations; why can these terms not be used?	My Profile	This feedback has been shared with AcA. Additional discussion is needed.
Download for Suggested Awards OK, assuming once my profile is more complete it would show a more bespoke list.	My Profile	The Suggested Awards tool presents a list of awards matched to you based on your research profile, for which you could potentially be nominated. Based on your research profile and the specific award, a Suitability Index is calculated by comparing characteristics of your profile with those of previous awardees.
No download option for Timeline? List of activities by year?	My Profile	This feedback has been shared with AcA. Additional discussion is needed.
The download button automatically defaults to CSV format. Can we have more download format options?	My Profile	This feedback has been shared with AcA. Additional discussion is needed.
Not sure reason for keyword word cloud Related Scholar reported was accurate in reporting key people in my field.	My Profile	The terms within the word cloud can be modified within the Edit Profile screen, which would then update the Related Scholars list.
The format for the csv downloaded from Works (also referred to as Related Works?!) is not useful. The data for the various categories is concatenated horizontally with data for categories separated by 2 empty columns. Much postprocessing is needed to make these data useful. Download of these data into separate sheets in the same file would be more useful.	My Profile	This feedback has been shared with AcA. Additional discussion is needed.
I am not sure what function related keywords, “word cloud,” function is meant to serve. The related scholars below are not connected to specific words (from what I can tell). This functionality may work better for researchers who have fewer interdisciplinary works.	My Profile	The terms within the word cloud can be modified within the Edit Profile screen, which would then update the Related Scholars list.
Under Type of Recognition, the categories are not clear. What is the “Professional” category for? Aren’t teaching, research and service awards professional awards? Also, isn’t research awards also academic awards?	Activities - Awards & Honors	AIRE is developing additional resource material for their website. The Professional category could be used for an activity in a non-acedemic field, but it is open to interpretation and guidance from unit leadership.
I was unsure about what to call an “award.” Does this include a small amount of funding ($1,000$2,500) awarded for research travel? I don’t understand all of the categories under “Type of Recognition.” What is “presenting”? Is “Academic” a catch all phrase?	Activities - Awards & Honors	AIRE is developing additional resource material for their website, and is working with AcA to add in-tool definitions and explanations.
As a researcher in the field of Visual Arts, I’m unsure as to where to add an Artist Residency opportunity, it seems most appropriate to put in Awards & Honors, but there is no option to state the location as is available in the Creative Works section. Residencies are a major / very common research opportunity in the field of Visual Arts but it doesn’t seem to be clear where to document this on Faculty Insight.	Activities - Awards & Honors	AIRE is developing additional resource material for their website, and is working with AcA to add in-tool definitions and explanations.
I realize that the system works on DOI’s but are there any alternatives for conference presentations/ proceedings?	Activities - Scholarship	Academic Analytics will soon have the ability to duplicate works in the system.
Professional Membership: This category is a bit opaque. I would use it for scientific society membership in which case Title /Position would be “Member”. However, it gets confusing since serving as president or secretary of a society would fall under Service in which case Title / Position would be more appropriately used.	Activities - Career	AIRE is developing additional resource material for their website, and is working with AcA to add in-tool definitions and explanations.
Exhibits & Installations: In the sciences, this would include museum exhibits. For this purpose, the option of “Ongoing” in dates would be useful and the required Work Status could include “Other” or “On exhibit” rather than the standard verbiage used for publications (i.e., in press, submitted, etc.); neither “In Progress” nor “Published/ Presented/Completed” seem appropriate here for an exhibit that is currently on display and will be displayed for multiple years. No other subcategories apply to the sciences.	Activities - Creative Works	AIRE is developing additional resource material for their website, and is working with AcA to add in-tool definitions and explanations.
I am unsure how to document a “Public Artwork”. These are often commissioned projects that can have competitive application processes, are often do not have a clear “end date” since they become part of a permanent collection and are accessible / public for long durations. This type of creative works perhaps needs it’s own field?	Activities - Creative Works	AIRE is developing additional resource material for their website, and is working with AcA to add in-tool definitions and explanations.
In Presentations in Type of Presentation, what is the difference between Paper Presentation and Individual Oral Presentation? Is Individual Oral Presentation reserved for single author presentations? Perhaps add a generis Oral Presentation option? Again, guidance is recommended for consistent entries across users and institutions.	Activities - Scholarship	Paper Presentation typically refers to presenting a formal paper and could be part of a panel of multiple authors.
Why is there only a choice to have peer-reviewed/ editorially reviewed together while refereed is separate. ? I think editorially reviewed should be separate category.	Activities - Scholarship	Academic Analytics has combined all three of these options to prevent confusion. We are in communications with AcA for best approach moving forward.
Some confusion on national vs online as scope/ impact	Activities - Scholarship	AIRE is developing additional resource material for their website, and is working with AcA to add in-tool definitions and explanations.
This is where the platform really underperforms. The standard Annual Report output is sorely inadequate for annual reports or program reviews! It is beyond the scope of this evaluation to list the ways in which the current format of the Annual Report falls short. FI is strongly encouraged to work with units to remedy at least some of the issues. [examples listed]	Reporting	This feedback has been shared with AcA. AIRE is currently reviewing the Annual and P&T reports, and working with AcA to identify for potential enhancements.

Faculty Insight User Testing Group Report

Return to Faculty Insight User Testing Group - 2025 Report