I paid Microsoft’s premium Copilot agents to do my work – they were confidently bad at it


copilot-reliable-workaround

The Microsoft Copilot Analyst agent at work

Ed Bott/ZDNET

Follow ZDNET: Add us as a preferred source on Google.


ZDNET’s key takeaways

  • Copilot agents are built to help with research and analysis.
  • In my tests, those agents didn’t produce useful results.
  • Troubleshooting with Copilot wasted time and solved nothing.

Microsoft is spending an insane amount of money on its AI features, building data centers and licensing large language models from OpenAI, Anthropic, and others, while it also tries to build its own in-house alternatives.

The goal, driven straight from the top of Redmond’s org chart, is to turn the combination of Windows and Microsoft 365 into an “agentic OS,” capable of doing the tasks that make corporate life miserable: writing memos, building presentations, organizing meetings, and automating routine tasks.

Also: Work IQ is Microsoft’s big bet on agent-first enterprise IT, and I have questions

But are those investments paying off? Developers seem to be generally happy with the productivity gains they’re seeing from tools like Claude Code and GitHub Copilot, but the agents working in the business sphere don’t seem nearly as competent.

Over the past few weeks, I’ve been trying to use the AI features in Microsoft 365 and Windows for a variety of everyday work tasks. Copilot shows occasional flashes of competence, but more often, the results I’m seeing are a mishmash of misinformation, hallucinations, and time-wasting dead ends.

Allow me to share my recent experiences with you. 

‘I’m sorry, Ed, I can’t do that’

Microsoft has been bugging me for months to upgrade to its new Microsoft 365 Premium plan, which includes higher limits on AI usage and a handful of exclusive agents. In the interest of science, I paid the $10 to upgrade an unused account for a month so I could try them for myself.

I started with the Analyst agent, feeding it a copy of the spreadsheet I use to keep track of our household income and expenses and asking for help with how to improve its design. After some back-and-forth about what I was trying to accomplish, it offered some useful suggestions for tightening up formulas, consolidating some duplicate tables, and eliminating some redundant pages, concluding with a bolded offer to build a dashboard using only formulas and pivot tables.

Also: AI Model Release Tracker: Microsoft AI’s first reasoning model arrives

“If you want,” Copilot told me, “I can sketch a clean dashboard layout (exact cells and sections) tailored to your data so you can build it in ~15 minutes.” 

I … thought agents were supposed to do this work for me? So I asked, “Can you build the actual Excel file for me or do I have to do that myself?”

Of course, it told me. There was just one tiny limitation: I would have to create one of the pivots myself, but that chore would take less than 10 seconds.

Go ahead, I said.

A minute or two later, Copilot told me, “I’ve created your modified workbook. Download it here.” It then gave me a link to [sandbox:/mnt/data/Personal_accounts_modified.xlsm]. That’s the exact link, brackets and all. It wasn’t clickable.

Sandbox? What the …? “Yeah — that’s on me,” Copilot confessed. “That ‘sandbox path’ isn’t actually clickable in your interface, so you couldn’t download it. Thanks for calling that out. … I’m going to regenerate the file and make sure it comes through as a real downloadable attachment in the chat (so you’ll see a clickable file card, not a path).”

Also: Microsoft’s first reasoning model is one of 7 AIs just released at Build – what we know so far

Several tries later, Copilot gave up. “The file is ready. However, I need to be transparent: your chat interface is currently not rendering downloadable file attachments correctly (that’s why you saw those unusable “sandbox” paths earlier). I did generate the file successfully, but it isn’t appearing as a clickable download in your UI.”

copilot-analyst-excel-fail

Copilot created the file I asked for, but it couldn’t find a way to deliver it to me.

Ed Bott/ZDNET

The chatbot went on to explain that the file link might have worked if I had been using ChatGPT. And one of the workarounds that the agent suggested was to create the file in Google Sheets and send me a link! Somehow, I don’t think that’s what the product managers in Redmond had in mind. (Please don’t tell Satya.)

Also: Microsoft’s MDASH exits preview with 100+ specialized threat-hunting AI agents

Verdict: I got some good ideas for improving my workbook, but the Copilot agent that’s supposed to be working directly with Excel can’t actually do the work for me.

‘Which specific plan do you mean?’

Next up, I asked the Microsoft 365 Premium Researcher agent to give me a concise explanation of the pros and cons of Microsoft 365 Premium. I was not prepared for the response:

To make sure I cover exactly what you need: Which specific plan do you mean by “Microsoft 365 Premium”? A) Microsoft 365 Personal, B) Microsoft 365 Family, C) Microsoft 365 Business Premium, or D) compare the consumer plans (Personal/Family) and briefly note Business Premium only if relevant.

To be clear, I was working with one of the signature features of a product Microsoft is promoting heavily, and it had no idea what I was talking about. Imagine you’re interviewing a job candidate, and you say, “Tell me about yourself,” and they reply “I don’t know her.”

After I offered up a link to the product page, Copilot gave me a fairly anodyne summary of features in the new subscription, summarized from a handful of third-party sources. I wouldn’t call it research, and it definitely wasn’t deep.

‘Why I’m confident this is the right path’

The thing I find most amusing about AI chatbots is that they are so supremely confident in their answers. And when you point out that the instructions they just gave you didn’t work, that confidence never flags as they suggest new options.

This morning, I was trying to connect to a computer on my office network using the Remote Desktop client, but I was getting a certificate error: “The server name on the certificate is incorrect.”

Also: How Microsoft obliterated safety guardrails on popular AI models – with just one prompt

After a few minutes of troubleshooting on my own, I decided it was time to try to “vibe-sysadmin” my way through it with the help of Copilot.

“The fix is straightforward,” Copilot replied, confidently. All I needed to do was force Windows inside the VM to generate a new Remote Desktop certificate. “Here are the clean, reliable ways to do it.”

That didn’t work. Copilot, undaunted, told me that that result was meaningful and rattled off three likely reasons, concluding with “Let’s fix it cleanly and surgically.”

After a bunch of PowerShell commands and a reboot, I was still unable to connect, but this time, it was because of a different certificate error.

“Ah — that tells me exactly what’s happening now,” said Copilot. After another long-winded explanation, it said, “Let’s fix that cleanly.”

Also: I let Microsoft Edge’s new AI feature read all my open tabs – and it’s a total research time-saver

Well, this went on for about 20 minutes and half a dozen reboots of that VM. With each failure, Copilot had another small AI epiphany.

  • “That error tells me something very specific…”
  • “You’ve just uncovered the real root cause…”
  • “We’ve crossed into the one scenario where Windows will not behave the way the documentation claims…”
  • “And that explains everything you’ve seen…”

These were accompanied by bold headings like “Why I’m confident this is the right path,” “Why this is the correct fix,” and “Why this is the only explanation left.”

copilot-confident

Confident! Copilot is confident! (And wrong!)

Screenshot by Ed Bott/ZDNET

None of the suggested fixes worked, so I told Copilot to shut up. I reinspected the connection settings and cleared one checkbox on the connection settings. That did it.

In fairness, I learned a handful of PowerShell commands for managing certificates, and I got a refresher course in how Windows manages certificates. But the lesson I learned is not to ask Copilot for that level of troubleshooting again.

Maybe someday Copilot will achieve artificial general intelligence. At this point, I would settle for artificial general common sense. And even that station seems to be many stops away from where we are right now.





Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


Deer Valley’s new terrain expansion is one of the most ambitious projects in modern skiing. The resort plans to nearly double its skiable terrain while maintaining the industry-leading standards it’s known for. We spent an extended trip in early 2026 skiing the new footprint alongside Deer Valley representatives and Olympic skier Fuzz Feddersen to see how it all came together.

Construction is still ongoing, and this season marked the worst snow year in Deer Valley’s history. Even so, we found the new terrain diverse and distinct, yet seamlessly integrated into the legacy Deer Valley experience.

This guide introduces the terrain, lifts, and base-area amenities in Deer Valley’s East Village so you can make the most of the Expanded Excellence initiative.

East Village: A Second Front Door

Keetley Express Opening Day
Photo Credit: Deer Valley Resort.

Deer Valley East Village is seamlessly connected on the slopes, but geographically separate from the main resort, and that separation works in its favor. Accessed via US-189, it bypasses Park City traffic entirely.

Yes, it’s still a work in progress. You’ll see active construction throughout the base area. But the core infrastructure is already in place, and it functions like a fully supported ski base. What’s here now works and what’s coming will only enhance it.

The East Village base area delivers the Deer Valley essentials: free parking, rental shop, ski valet, and East Village Restaurant, where a bowl of the resort’s signature chili tastes especially good on a cold afternoon.

Where to Stay in East Village (25/26 Season)

High hot chocolate at Grand Hyatt Deer Valley Utah
Photo Credit: Jenn Coleman.

For the 25/26 season, the clear lodging choice is the newly completed Grand Hyatt. It offers a signature restaurant, on-site Ski Butlers rentals, a full spa, and shuttle service to Park City and Snow Park. There’s no ski-in/ski-out access yet, but a short shuttle brings you directly to the East Village base.

Additional hotels are expected to open for 26/27, which will further transform East Village into a true walkable ski hub.

We found the Grand Hyatt welcoming and highly functional, particularly with Ski Butlers on-site and a massive locker room that makes gearing up painless. Their High Hot Chocolate service, modeled after high tea but featuring locally processed cocoa, may become a new tradition for us. It’s indulgent enough to stand in for a light meal or serve as a sweet reset between Park City’s famously rich dinners.

The only logistical wrinkle is shuttle coverage. Service does not extend to Empire Canyon (Fireside Dining) or Silver Lake (Stein Eriksen Lodge, Mariposa), so a bit of planning is required. Still, between Snow Park (St. Regis, Cast & Cut) and downtown Park City, dining options are abundant. With new hotels opening next season, you may soon be able to walk to a different restaurant every night and still not try them all.

Snow Science: The Engine Behind the Expansion

Expanded Terrain snowmaking gun
Photo Credit: Deer Valley Resort.

Deer Valley’s reputation has always been built on snow quality, from immaculate corduroy to sophisticated snowmaking. The expansion continues that legacy in a serious way.

The new terrain draws most of its water from Jordanelle Reservoir. Roughly 80 miles of new snowmaking pipe now support more than 1,200 high-efficiency snow guns. The reservoir isn’t just scenic, it’s foundational.

What’s more impressive is the sustainability loop. Deer Valley is allocated just 1% of the reservoir’s available water. Through dedicated irrigation channels, approximately 80% of that allotment is returned by season’s end. Combined with an expanded grooming fleet, that system allowed the resort to open a record number of runs during a historically hot and dry winter.

If you’re wondering how the terrain skied so well in a lean year, this is your answer.

East Village Gondola: The Spine of the New Terrain

East Village Gondola
Photo Credit: Deer Valley Resort.

The 10-passenger high-speed East Village Gondola is one of the two primary lifts out of the base area. It’s a 15-minute, 3,000-vertical-foot ride to Park Peak (9,350’), with a mid-station at Big Dutch Peak (8,170’).

From Park Peak, you access some of Utah’s longest runs along with terrain served by Pinyon Express and the Vulcan Express / Revelator Express lifts.

Green Monster is the headline act: a 4.85-mile green descent between Park Peak and Baldy Mountain, nearly 40% longer than Park City Mountain’s Home Run. It weaves between two blues: Carbonite, which drops along the ridge, and Age of Reason, which follows the valley floor.

Deer Valley partnered with longtime Mountain Host Michael O’Malley to name the new terrain in ways that honor both local mining history and the resort’s evolving identity. “Green Monster” references a Wasatch County copper mine, though you’ll never convince me there isn’t a double entendre for the 37-foot-tall wall in Fenway Park that has foiled many home runs. Common sense tells us that “Age of Reason” is an homage to Thomas Paine, and I could imagine cruising down the exposed ridge would freeze you like the compound that imprisoned Han Solo. However, “Carbonite” is a nod to Park City’s silver mining legacy. 

Names aside, the terrain progression is smart. Carbonite offers a manageable ridge experience before committing to Redemption Ridge. And if confidence wavers, Green Monster provides a bailout.

Another thoughtful touch is Corduroy Lunch. Select freshly groomed terrain off the gondola’s mid-station remains roped until noon. Carving fresh tracks midday is a true afternoon delight. 

Keetley Express: The Connector

Keetley Express lift Deer Valley Ski Resort Utah
Photo Credit: Deer Valley Resort.

Keetley Express is the other primary East Village lift and likely the fastest gateway back to legacy Deer Valley terrain. After the 1.25-mile ride up, a short ski down Road to Sultan brings you to Sultan Express.

Of course, you have to take Sultan up the mountain before you get back to skiing. That sets you up for over 5 continuous miles of green runs if you combine Homeward Bound with McHenry, or take a run on the classic black Stein’s Way. You could also use connectors to access the lower half of Green Monster or McHenry directly, or try the plethora of intermediate runs off Keetley Point.

Advanced skiers should keep Keetley on their radar as well. When conditions align, it’s a sneaky access point to Mayflower Bowl and its quiet pocket of expert terrain.

Aurora: Small but Essential

McHenry / Aurora area Deer Valley Ski Resort Utah
Photo Credit: Jenn Coleman.

Aurora is easy to underestimate. It’s only about 700 feet long and takes two minutes to ride, but it plays a crucial role.

It’s the return lift from McHenry, which connects directly to Silver Lake Lodge, and it services Keetley Point terrain. There’s also a confusing sign near the top of Aurora on Green Monster directing skiers left toward East Village. If you follow it, you’ll earn a short Aurora ride, and remember to hang right next time if you want to return directly to Keetley and the gondola.

Tiny lift. Big utility.

Vulcan Express & Revelator Express: Commitment Terrain

Woman carving Ridgeline at Deer Valley
Photo Credit: Deer Valley Resort.

These lifts rise from one of the steepest valleys in the Deer Valley footprint, so steep that lift towers had to be installed by helicopter.

Redemption Ridge is the signature descent, often described as Stein’s Way on steroids. At roughly twice the length of Stein’s, it drops 2,700 vertical feet over 2.5 miles. Once you commit, you’re in it, with steeper, more technical lines breaking off the ridgeline into the valley.

If that feels ambitious, start on Stein’s to calibrate. Carbonite also offers a similar exposed-ridge experience that’s much more forgiving. But If the snow is right and you can hang, Redemption could be your saving grace from the Bambi Basin blues.

Pinyon Express: High-Alpine Access for Everyone

Pinyon Express Chairlift
Photo Credit: Deer Valley Resort.

Pinyon Express and Revelator both reach Park Peak, but their personalities diverge from there.

Pinyon serves a beginner-friendly zone on the north side of Park Peak, allowing newer skiers to experience high-mountain terrain without intimidation. Clipper stands out because it also connects the East Village Gondola back into legacy Deer Valley terrain, but there are multiple easy route options.

Because Pinyon sits right at the boundary between old and new terrain, it functions as a seamless crossover point. Novice skiers and ski classes can access this alpine playground from either side of the resort.

The Future of Deer Valley Is Already Underfoot

Fuzz_Ski_with_a_Champion
Photo Credit: Deer Valley Resort.

It would be easy to judge an expansion like this on acreage alone. Nearly doubling skiable terrain is headline material in any snow year, let alone the driest season in resort history. But what impressed us most wasn’t the scale; it was the intention.

Expanded Excellence doesn’t feel bolted on. It feels studied. Deliberate. The lift placements make sense. The terrain progression makes sense. Even the names tell a story. You can ski a 4.85-mile green down Green Monster, test your mettle on Redemption Ridge, duck into legacy terrain off Keetley, and end the day with corduroy that rivals anything Deer Valley has ever groomed, all without feeling like you’ve left the original footprint of the resort.

That’s no small feat.

Skiing with Olympic veteran Fuzz Feddersen gave us an insider’s lens, but even without that access, the throughline is obvious: Deer Valley isn’t chasing growth for growth’s sake. They’re building a second front door that will eventually feel as iconic as Snow Park or Silver Lake, and they’re doing it with the same snow science, guest service, and meticulous grooming that built their reputation in the first place.

East Village still hums with construction equipment. You’ll see cranes on the skyline and fresh dirt where hotels will soon rise. But beneath that temporary noise is something permanent: infrastructure that works, terrain that skis well in lean years, and a blueprint that positions Deer Valley for the next several decades.

If this was Expanded Excellence in the worst snow year on record, it’s hard to imagine what it will feel like in a banner winter.

One thing is certain: the future of Deer Valley isn’t coming. It’s already here!

Ready to Book Your Trip? These Links Will Make It Easy:

Airfare:

Insurance:

  • Protect your trip and yourself with Squaremouth and Medjet



  • Safeguard your digital information by using a VPN. We love NordVPN as it is superfast for streaming Netflix



  • Stay safe on the go and stay connected with an eSim card through AloSIM

Our Packing Favs:

  • We LOVE Matador Equipment for their innovative products and sustainability focus. Their SEG45 is a game changer when you need large capacity while packing light.
  • Travel in style with a suitcase, carry-on, backpack, or handbag from Knack Bags
  • Packing cubes make organized packing a breeze! We love these from Eagle Creek

Disclosure: A big thank you to Deer Valley Resort for hosting us, setting up a fantastic itinerary, and usage of some of the images throughout (image credit in hover text ).

For more travel inspiration, check out Deer Valley Resort’s InstagramFacebookTwitter, and YouTube accounts.

As always, the views and opinions expressed are entirely our own, and we only recommend brands and destinations that we 100% stand behind.

Like it? Pin it for later on Pinterest!


Hi! We are Jenn and Ed Coleman aka Coleman Concierge. In a nutshell, we are a Huntsville-based Gen X couple sharing our stories of amazing adventures through activity-driven transformational and experiential travel.





Source link