Getting Feedback from Claude: AI Fluency Index

I’ve been using Claude (Max) for a month or so, exploring the capability of this tool as both a thought partner and research assistant, logging nearly 200 individual sessions. As I am learning more about AI fluency as an access competency, I discovered that Claude can provide feedback to assess my own skills in interacting with it, looking at my roles in Description, Delegation, Discernment, and Diligence.

Claude even provides a scorecard that evaluates how effectively I interact with AI across 11 indicators. The AI Fluency Index reviews a sample of my most recent 20 interactions and offers feedback on what’s working well (and what’s not). Some of the feedback I received aligned comfortably with my deeply internalized media literacy competencies, but other practices are new things that I am continuing to learn as I use AI. Here’s what I’m already doing well:

• Goal Clarification: I state what I’m trying to accomplish before requesting help.

• Specify Target Audience and Format: I specify who the output is for and indicate a desired genre and format.

• Communicate Tone: I indicate the voice, tone, or style I want.

• Build iteratively: I refine with follow-ups rather than accepting the first result.

• Check Facts — I question or verify information in AI output.

• Notice reasoning: I push back when the AI’s logic seems off.

• Recognize context: I share context that the AI could not know to help frame the nature of the task.

Here are some AI fluency strategies that I am not yet using regularly (but should be):

• Consult on Approach: Do I ask which approach to take before requesting execution on a large project?

• Provide examples: Do I share examples to demonstrate quality expectations?

• Set interaction — Do I tell Claude how to behave, what role to adopt, or what interaction style to use? This could include role-setting like “play the devil’s advocate on this.”

I’m going to be learning more and experimenting with using these concepts with my own students enrolled in Media Literacy COM 250 and Propaganda COM 416 this fall. Stay tuned!