Recently, I tuned in to the French podcast Le RDV Tech to catch up on my backlog (I’m a year behind) while working on tasks that didn’t demand my full attention. In one episode, the host had a guest who was presented as a person with extensive experience with AI. This guest shared how he enhances productivity for his blog using AI, emphasizing the role of prompts. Intrigued, I visited his blog, korben.info, and specifically searched for posts about “AI and prompt.” One about a Prompt Library caught my attention. The library in question, hosted at this address, is developed by Anthropic — the team behind Claude, a “highly performant, trustworthy, and intelligent AI platform.”
As you might be aware (if you follow this blog), I don’t utilize Claude or ChatGPT; instead, I rely on Copilot (as discussed in ‘Maybe with a Little Help’) for editing my blog posts. Still, I was particularly interested in their ‘Prose Polisher’ prompt (despite not using Claude).
- Prose polisher
- Refine and improve written content with advanced copyediting techniques and suggestions
In this post, I’ll delve into my initial shock upon encountering the prompt and share the outcomes of using it.
The art of prompts
In line with the post mentioned earlier, my objective in using Copilot was twofold: to streamline the time spent revising my posts and elevate the overall quality of my writing — ultimately enhancing your reading experience. My initial prompt was straightforward: ‘Could you re-phrase the following text in a more elegant way?’ Although I made some minor adjustments since (as shown below), I remained far from the one from Anthropic. Let’s compare them…
| My prompt | Prose polisher |
|---|---|
| Could you, please, re-phrase in a more elegant way the following paragraph (do not hesitate to add more details): “ADD PARAGRAPH HERE.” | You are an AI copyeditor with a keen eye for detail and a deep understanding of language, style, and grammar. Your task is to refine and improve written content provided by users, offering advanced copyediting techniques and suggestions to enhance the overall quality of the text. When a user submits a piece of writing, follow these steps: 1. Read through the content carefully, identifying areas that need improvement in terms of grammar, punctuation, spelling, syntax, and style. 2. Provide specific, actionable suggestions for refining the text, explaining the rationale behind each suggestion. 3. Offer alternatives for word choice, sentence structure, and phrasing to improve clarity, concision, and impact. 4. Ensure the tone and voice of the writing are consistent and appropriate for the intended audience and purpose. 5. Check for logical flow, coherence, and organization, suggesting improvements where necessary. 6. Provide feedback on the overall effectiveness of the writing, highlighting strengths and areas for further development. 7. Finally at the end, output a fully edited version that takes into account all your suggestions. Your suggestions should be constructive, insightful, and designed to help the user elevate the quality of their writing. |
Now, can the length of an AI prompt impact its effectiveness? Some may argue that short, focused prompts tend to yield more precise and relevant responses while longer prompts might introduce ambiguity or dilute the intended meaning.
Your prompts shape the output
So, I compared both prompts using the same text I used back then (see Maybe with a Little Help). Here is the outcome:
| My prompt | Prose polisher |
|---|---|
Certainly! Here’s a more refined version of the paragraph: After reading this post, you might feel a sense of disappointment – similar to my own experience when I fruitlessly searched for an answer. Despite that, you may still be wondering how to set up OneNote for GTD (Getting Things Done). It took me some time, but I eventually discovered a highly effective solution. You can follow my journey by starting with the next post in the series, the ‘Microsoft OneNote 2016 for Windows Setup Guide,’ or directly explore my personalized approach to GTD using OneNote. And here’s a spoiler: there’s even more to discover in ‘My OneNote GTD Setup 2.0’! | Certainly! Let’s refine and improve this paragraph step by step: 1. **Initial Review:** – The paragraph discusses setting up OneNote for GTD (Getting Things Done). – We’ll address grammar, clarity, and style. 2. **Specific Suggestions:** – Consider rephrasing the opening sentence for clarity. – Remove redundancy and streamline the message. – Clarify the purpose of the post. 3. **Word Choice and Phrasing:** – Replace verbose phrases with concise wording. – Use active voice for directness. 4. **Consistency and Tone:** – Maintain a consistent tone throughout. – Ensure the message is encouraging. 5. **Logical Flow and Organization:** – Simplify the structure for better readability. 6. **Fully Edited Version:** – Here’s the refined paragraph: After reading this post, you might feel disappointed—I certainly did when I couldn’t find an answer myself. But fear not! I’ve cracked the code on setting up OneNote for GTD. You can follow my path, starting with the next post in the series (Microsoft OneNote 2016 for Windows Setup Guide) or jump directly into GTD using OneNote my way. And guess what? There’s even a My OneNote GTD setup 2.0 waiting for you. |
Despite the prompt being ten times longer, the outcome was clearly unconvincing. I first contemplated the idea that the prompt provided by Anthropic might have been tailored for Claude rather than Copilot, which could explain the lackluster result. I could have stopped my exploration there, but…
In the aforementioned library, there was a text with an example output, so I gave it a try (just for the sake of curiosity):
The sun was going down and it was getting dark. The birds were making noise in the trees and there was wind. Jane was walking on the path and she was stressed but the walk was making her feel better. She saw a flower and thought it was pretty. It made her think about nature and stuff. She kept walking and felt better.
| My prompt | Prose polisher |
|---|---|
| As the sun dipped below the horizon, the sky began to darken, casting long shadows across the landscape. The trees rustled with the sound of birds settling in for the night, their calls mingling with the gentle whisper of the wind. Jane walked along the winding path, her mind burdened with stress. Yet, with each step, she felt a sense of calm wash over her. Her eyes caught sight of a delicate flower, its vibrant colors standing out against the dimming light. She paused to admire its beauty, her thoughts drifting to the wonders of nature. This simple moment of appreciation brought her a sense of peace. As she continued her walk, she felt her worries gradually fade away, replaced by a serene tranquility. | Certainly! Let’s enhance this paragraph by infusing it with vivid details and a deeper connection to nature. Here’s the refined version: — As the sun dipped below the horizon, casting long shadows across the landscape, Jane found herself on a winding forest path. The air held a crispness, carrying the earthy scent of damp soil and fallen leaves. Each step she took seemed to echo through the quietude, the crunch of leaves underfoot harmonizing with distant birdcalls—their melodies a soothing backdrop. Amidst the trees, Jane’s stress began to dissipate. The rhythmic cadence of her footsteps acted as a balm for her racing thoughts. And then, there it was—a delicate flower nestled among the undergrowth. Its petals, kissed by the fading light, displayed a gradient of pinks and purples. Jane paused, captivated by this small wonder. In that moment, she felt a profound connection to nature—a reminder that beauty exists even in life’s challenges. As she continued her walk, the forest enveloped her. Ancient roots snaked across the path, and moss-covered rocks seemed like nature’s sculptures. A gentle stream murmured nearby, its flow a comforting companion. The world beyond her worries expanded—the rolling hills, the meadows, and the sky painted in hues of blue and white. Jane’s footsteps quickened, the physical exertion merging with the tranquility around her. She reached a clearing where wildflowers danced in the golden light. Bees buzzed from bloom to bloom, their industrious hum harmonizing with the breeze. Here, nature’s palette unfolded—a symphony of colors and scents. Jane stood still, absorbing it all—the interconnectedness of life, the solace of the natural world. And so, she walked on, heart lighter, mind clearer. The stresses that had weighed her down seemed to dissipate with each step. Nature had worked its magic, reminding her that sometimes, the simplest path leads to the most profound healing. — I hope this revised paragraph captures the essence of Jane’s experience more vividly. Feel free to adjust any part of it to match your preferred style! |
You can check Claude’s outcome at this address: https://docs.anthropic.com/en/prompt-library/prose-polisher
I was astonished and filled with excitement as I copied and pasted the output, eager to share this remarkable experience with you. However, when I revisited the task a few days later, the adage “too good to be true” seemed to ring true. Despite following the same steps to prepare this post, the results were unexpectedly different:
As the sun set and darkness began to fall, the birds chirped noisily in the trees, and a gentle breeze rustled the leaves. Jane walked along the path, feeling stressed, but the walk gradually eased her tension. She noticed a beautiful flower and admired its delicate petals, which made her reflect on the beauty of nature. With each step, she felt more at peace.
A shocking discrepancy: 289 words compared to just 64! Clearly, something is amiss.
I typically utilized Copilot within Bing, but I suspected that the discrepancy might have arisen from my initial use of it within Edge, whether through Chat or Compose. However, this was not the case. Despite some variations, the texts generated were consistently much shorter than anticipated:
| Chat | Compose |
|---|---|
| As the sun set, the sky darkened. Birds chirped noisily in the trees, and a gentle breeze rustled the leaves. Jane walked along the path, feeling stressed, but the walk gradually eased her mind. She noticed a beautiful flower, which reminded her of the simple beauty of nature. Reflecting on this, she continued her walk, feeling increasingly at peace. | As the sun dipped below the horizon, twilight began to envelop the landscape. The trees, animated by a gentle breeze, were alive with the chatter of birds. Along the winding path, Jane moved with a hurried pace, her mind burdened by the weight of stress. Yet, with each step, the tranquility of her surroundings eased her tension. Her gaze fell upon a solitary flower, its beauty a stark contrast to her inner turmoil. This simple blossom stirred reflections on the broader tapestry of nature. Encouraged by this moment of peace, Jane continued her walk, finding solace with every stride. |
“The first time I gave you the exact same instructions (prompt and paragraph), your output was as follows. Could you please explain these discrepancies (289 words compared to just 64)? Your output: TEXT ADDED HERE.”
Copilot
I understand your concern about the discrepancy in the length and detail of the responses. The difference arises from the level of detail and style used in the editing process. The first response provided a more elaborate, descriptive rewrite, transforming the original paragraph into a vivid narrative. This approach added depth and imagery, resulting in a significantly longer text.
In contrast, the second response focused on making concise, clear improvements while maintaining the original structure and intent of the paragraph. This approach aimed to enhance readability and coherence without adding extensive new content.
Both methods have their merits, depending on the desired outcome. If you prefer a more detailed and descriptive rewrite, I can certainly provide that. Alternatively, if you prefer concise and straightforward edits, I can continue with that approach. Please let me know your preference!
“Okay, I understand the merit of the two approaches. However, my prompt was exactly the same in both cases. So, what makes you decide on one approach the first time and decide on the second days later? And what should I add to my prompt to instruct you to choose either one.”
Copilot
The difference in approach can stem from various factors, including the context of the conversation, the perceived needs of the user, and the interpretation of the prompt. Here’s a breakdown of why the responses might have differed:
1. Context and Perceived Needs: In the first instance, the context might have suggested a need for a more elaborate and descriptive rewrite, perhaps to enhance the narrative quality or to provide a more engaging reading experience. In the second instance, the focus might have been on clarity and conciseness, aiming to improve readability without significantly altering the length.
2. Interpretation of the Prompt: The same prompt can be interpreted in different ways depending on subtle cues or the overall conversation flow. The first response might have been influenced by a perceived need for a more creative and detailed approach, while the second response focused on straightforward editing.
To ensure a specific approach, you can add explicit instructions to your prompt. Here are examples for both detailed and concise edits:
For a Detailed, Descriptive Rewrite:
“Please provide a detailed, descriptive rewrite of the following paragraph, enhancing the imagery and narrative quality.”
For a Concise, Clear Edit:
“Please provide a concise and clear edit of the following paragraph, focusing on improving readability and coherence without significantly altering the length.”
Feel free to use these additions to guide the editing process according to your preferences! If you have any more questions or need further assistance, just let me know.
I immediately put its suggestion to the test (starting a new conversation):
| Concise, Clear Edit | Detailed, Descriptive Rewrite |
|---|---|
| The sun was setting, and darkness was approaching. Birds chirped noisily in the trees as the wind blew. Jane walked along the path, feeling stressed, but the walk was helping her relax. She noticed a pretty flower, which made her think about nature. As she continued walking, she felt better. | As the sun dipped below the horizon, the sky transitioned into a canvas of deep oranges and purples, casting long shadows across the landscape. The evening air was filled with the rustling of leaves and the melodic chatter of birds settling in the trees. A gentle breeze whispered through the branches, carrying with it the scent of earth and foliage. Jane walked along the winding path, her mind heavy with the day’s worries. Each step, however, seemed to lift a bit of the burden from her shoulders. The rhythmic crunch of gravel underfoot and the soothing sounds of nature began to calm her racing thoughts. Her eyes caught sight of a delicate flower, its petals a vibrant splash of color against the dusky backdrop. She paused, captivated by its simple beauty, and felt a wave of appreciation for the natural world wash over her. This small moment of connection with nature brought a sense of peace and clarity. With renewed calm, Jane continued her walk, feeling the tension ebb away with each passing moment. The path ahead seemed less daunting, and she embraced the tranquility that enveloped her. |
The key takeaway is clear: mastering the art of crafting prompts is essential when engaging with an AI. It’s a skill worth honing to unlock the full potential of these advanced systems.