[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"nav-categories":3,"article-government-test-finds-that-ai-wildly-underperforms-compared-to-human-employees":70},{"data":4},[5,37,57,64],{"name":6,"slug":7,"categories":8},"Productivity","productivity",[9,13,17,21,25,29,33],{"id":10,"title":11,"slug":12},17,"Branding","branding",{"id":14,"title":15,"slug":16},19,"Marketing","marketing",{"id":18,"title":19,"slug":20},20,"Work","work",{"id":22,"title":23,"slug":24},34,"Community","community",{"id":26,"title":27,"slug":28},21,"For newbies","for-newbies",{"id":30,"title":31,"slug":32},24,"Investment","investment",{"id":34,"title":35,"slug":36},22,"Finance","finance",{"name":38,"slug":39,"categories":40},"Tech","tech",[41,45,49,53],{"id":42,"title":43,"slug":44},28,"Technology","technology",{"id":46,"title":47,"slug":48},32,"Artificial Intelligence","artificial-intelligence",{"id":50,"title":51,"slug":52},26,"Security and protection","security-and-protection",{"id":54,"title":55,"slug":56},31,"YouTube Blog","youtube-blog",{"name":58,"slug":59,"categories":60},"News","news",[61],{"id":62,"title":58,"slug":63},18,"quasanews",{"name":65,"slug":66,"categories":67},"Business","business",[68],{"id":69,"title":65,"slug":66},16,{"post":71,"published_news":96,"popular_news":163,"categories":232},{"title":72,"description":73,"meta_title":72,"meta_description":73,"meta_keywords":74,"text":75,"slug":76,"created_at":77,"publish_at":78,"formatted_created_at":79,"category_id":46,"links":80,"view_type":85,"video_url":86,"views":87,"likes":88,"lang":89,"comments_count":90,"category":91},"Government Test Finds That AI Wildly Underperforms Compared to Human Employees","That potential, the trial found, is not looking promising.","Government, AI Wildly Underperforms Compared to Human Employees","\u003Cp>Hello!\u003C/p>\n\n\u003Cp>Generative \u003Ca href=\"https://quasa.io/media/what-are-the-benefits-and-risks-of-artificial-intelligence\">AI\u003C/a> is absolutely terrible at summarizing information compared to humans, according to the findings of a trial for the Australian Securities and Investment Commission (ASIC) spotted by Australian outlet \u003Cem>Crikey\u003C/em>.\u003C/p>\n\n\u003Cp>\u003Cpicture class=\"image-align-left\">\u003Csource srcset=\"https://cdn.quasa.io/photos/foto-19/mmmmmmmmmmmmmmmmmm-3.webp\" type=\"image/webp\">\u003Cimg alt=\"Government Test Finds That AI Wildly Underperforms Compared to Human Employees\" class=\"image-align-left\" height=\"183\" src=\"https://cdn.quasa.io/photos/foto-19/mmmmmmmmmmmmmmmmmm-3.jpeg\" width=\"275\" />\u003C/picture>The trial, conducted by Amazon Web Services, was commissioned by the government regulator as a proof of concept for generative AI's capabilities, and in particular its potential to be used in business settings. That potential, the trial found, is not looking promising.\u003C/p>\n\n\u003Cp>In a series of blind assessments, the generative \u003Ca href=\"https://quasa.io/media/artificial-intelligence-visual-search-and-the-future-of-shopping\">AI\u003C/a> summaries of real government documents scored a dire 47 percent on aggregate based on the trial's rubric, and were decisively outdone by the human-made summaries, which scored 81 percent.\u003C/p>\n\n\u003Cp>The findings echo a common theme in reckonings with the current spate of generative AI technology: not only are AI models a poor replacement for human workers, but their awful reliability means it's unclear if they'll have any practical use in the workplace for the majority of organizations.\u003C/p>\n\n\u003Ch4>\u003Cstrong>Signature Shoddiness\u003C/strong>\u003C/h4>\n\n\u003Cp>The assessment used Meta's open source Llama2-70B, which isn't the newest model out there, but with up to 70 billion parameters, it's certainly a capable one.\u003C/p>\n\n\u003Cp>\u003Cpicture class=\"image-align-left\">\u003Csource srcset=\"https://cdn.quasa.io/photos/foto-19/mmmmmmmmmmmmmmmmmm-14.webp\" type=\"image/webp\">\u003Cimg alt=\"Government Test Finds That AI Wildly Underperforms Compared to Human Employees\" class=\"image-align-left\" height=\"194\" src=\"https://cdn.quasa.io/photos/foto-19/mmmmmmmmmmmmmmmmmm-14.jpeg\" width=\"259\" />\u003C/picture>The AI model was instructed to summarize documents submitted to a parliamentary inquiry, and specifically to focus on what was related to ASIC, such as where the organization was mentioned, and to include references and page numbers. Alongside the AI, human employees at ASIC were asked to write summaries of their own.\u003C/p>\n\n\u003Cp>Then five evaluators were asked to assess the human and the AI-generated summaries after reading the original documents. These were done blindly — the summaries were simply labeled A and B — and scorers had no clue that AI was involved at all.\u003C/p>\n\n\u003Cp>Or at least, they weren't supposed to. At the end, when the assessors had finished up and were told about the true nature of the experiment, three said that they suspected they were looking at AI outputs, which is pretty damning on its own.\u003C/p>\n\n\u003Ch4>\u003Cstrong>Sucks On All Counts\u003C/strong>\u003C/h4>\n\n\u003Cp>All in all, the \u003Ca href=\"https://quasa.io/media/how-is-artificial-intelligence-revolutionizing-the-home-decor-industry\">AI\u003C/a> performed lower on \u003Cem>all criteria\u003C/em> compared to the human summaries, the report said. Strike one: the AI model was flat-out incapable of providing the page numbers of where it got its information.\u003C/p>\n\n\u003Cp>That's something the report notes can be fixed with some tinkering with the AI model. But a more fundamental issue was that it regularly failed to pick up on nuance or context, and often made baffling choices about what to emphasize or highlight.\u003C/p>\n\n\u003Cp>\u003Cpicture class=\"image-align-left\">\u003Csource srcset=\"https://cdn.quasa.io/photos/foto-19/mmmmmmmmmmmmmmmmmm-7.webp\" type=\"image/webp\">\u003Cimg alt=\"Government Test Finds That AI Wildly Underperforms Compared to Human Employees\" class=\"image-align-left\" height=\"171\" src=\"https://cdn.quasa.io/photos/foto-19/mmmmmmmmmmmmmmmmmm-7.jpeg\" width=\"294\" />\u003C/picture>Beyond that, the AI summaries tended to include irrelevant and redundant information and were generally "waffly" and "wordy."\u003C/p>\n\n\u003Cp>The upshot: these AI summaries were so bad that the assessors agreed that using them could require \u003Cem>more work\u003C/em> down the line, because of the amount of fact-checking they require. If that's the case, then the purported upsides of using the technology — cost-cutting and time-saving — are seriously called into question.\u003C/p>\n\n\u003Cp>Thank you!\u003Cbr />\nJoin us on social media!\u003Cbr />\nSee you!\u003C/p>","government-test-finds-that-ai-wildly-underperforms-compared-to-human-employees","2024-09-30T20:02:32.000000Z","2024-09-30T06:30:00.000000Z","30.09.2024",{"image":81,"image_webp":82,"thumb":83,"thumb_webp":84},"https://cdn.quasa.io/images/news/aoBDFfog34T5ChnDMGzmqPCFTCO70uJCvUnjy8WV.jpg","https://cdn.quasa.io/images/news/aoBDFfog34T5ChnDMGzmqPCFTCO70uJCvUnjy8WV.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/aoBDFfog34T5ChnDMGzmqPCFTCO70uJCvUnjy8WV.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/aoBDFfog34T5ChnDMGzmqPCFTCO70uJCvUnjy8WV.webp","large",null,1037,2,"en",0,{"id":46,"title":47,"slug":48,"meta_title":92,"meta_description":93,"meta_keywords":93,"deleted_at":86,"created_at":94,"updated_at":95,"lang":89},"Artificial Intelligence | AI Breakthroughs, Agents & Tools | QUASA","Artificial Intelligence, ai, ml, machine learning, chatgpt, future","2024-09-22T08:08:27.000000Z","2026-04-22T14:56:34.000000Z",[97,113,124,137,150],{"title":98,"description":99,"slug":100,"created_at":101,"publish_at":102,"formatted_created_at":103,"category":104,"links":105,"view_type":110,"video_url":86,"views":111,"likes":90,"lang":89,"comments_count":90,"is_pinned":112},"Don’t Try to Leave YouTube","Once a YouTuber, always a YouTuber.In a wide-ranging March 2026 interview with The New York Times, YouTube CEO Neal Mohan delivered a message that was equal parts confident and quietly ruthless: the platform has no serious rivals, and it knows it. YouTube isn’t just winning the streaming wars — it has already won the war for attention itself.","don-t-try-to-leave-youtube","2026-04-27T14:41:19.000000Z","2026-05-02T11:33:00.000000Z","02.05.2026",{"title":55,"slug":56},{"image":106,"image_webp":107,"thumb":108,"thumb_webp":109},"https://cdn.quasa.io/images/news/x6ojqt1IHGAiGy0Q99GtZLG5eEHoWAYayTMHga6Q.jpg","https://cdn.quasa.io/images/news/x6ojqt1IHGAiGy0Q99GtZLG5eEHoWAYayTMHga6Q.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/x6ojqt1IHGAiGy0Q99GtZLG5eEHoWAYayTMHga6Q.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/x6ojqt1IHGAiGy0Q99GtZLG5eEHoWAYayTMHga6Q.webp","small",29,false,{"title":114,"description":115,"slug":116,"created_at":117,"publish_at":117,"formatted_created_at":103,"category":118,"links":119,"view_type":85,"video_url":86,"views":46,"likes":90,"lang":89,"comments_count":90,"is_pinned":112},"Smart Tips for Buying a Vehicle for Your Small Business","When buying a vehicle for your small business, the debate is always between a newer model or pre-owned. Read this to understand which is best for your business.","smart-tips-for-buying-a-vehicle-for-your-small-business","2026-05-02T10:42:08.000000Z",{"title":65,"slug":66},{"image":120,"image_webp":121,"thumb":122,"thumb_webp":123},"https://cdn.quasa.io/images/news/hzod2rb7tkt9WuA8MXt5NOr1VsFVHtzhNEfiCpwf.png","https://cdn.quasa.io/images/news/hzod2rb7tkt9WuA8MXt5NOr1VsFVHtzhNEfiCpwf.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/hzod2rb7tkt9WuA8MXt5NOr1VsFVHtzhNEfiCpwf.png","https://cdn.quasa.io/thumbs/news-thumb/images/news/hzod2rb7tkt9WuA8MXt5NOr1VsFVHtzhNEfiCpwf.webp",{"title":125,"description":126,"slug":127,"created_at":128,"publish_at":129,"formatted_created_at":103,"category":130,"links":131,"view_type":110,"video_url":86,"views":136,"likes":90,"lang":89,"comments_count":90,"is_pinned":112},"Not Microdramas, But TikTok Dramas: The Platform Is Now Actively Producing Its Own Mini-Series","TikTok is no longer content with just hosting short-form videos. The social media giant is stepping directly into scripted entertainment by producing its own original mini-dramas — bite-sized, vertical soap operas designed for endless mobile scrolling.","not-microdramas-but-tiktok-dramas-the-platform-is-now-actively-producing-its-own-mini-series","2026-04-27T14:29:34.000000Z","2026-05-02T09:18:00.000000Z",{"title":58,"slug":63},{"image":132,"image_webp":133,"thumb":134,"thumb_webp":135},"https://cdn.quasa.io/images/news/9kafcKafFSK0czAQ0g8PYfOIPU5xeSRcOhkSfPOC.jpg","https://cdn.quasa.io/images/news/9kafcKafFSK0czAQ0g8PYfOIPU5xeSRcOhkSfPOC.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/9kafcKafFSK0czAQ0g8PYfOIPU5xeSRcOhkSfPOC.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/9kafcKafFSK0czAQ0g8PYfOIPU5xeSRcOhkSfPOC.webp",41,{"title":138,"description":139,"slug":140,"created_at":141,"publish_at":142,"formatted_created_at":103,"category":143,"links":144,"view_type":110,"video_url":86,"views":149,"likes":90,"lang":89,"comments_count":90,"is_pinned":112},"The Streaming Wars Take Flight: How Starlink is Reshaping In-Flight Entertainment","For decades, in-flight entertainment meant whatever was pre-loaded onto the seatback screen — a limited library of movies, TV shows, and games updated slowly and chosen by the airline. That era is ending.","the-streaming-wars-take-flight-how-starlink-is-reshaping-in-flight-entertainment","2026-04-27T14:10:32.000000Z","2026-05-02T06:02:00.000000Z",{"title":43,"slug":44},{"image":145,"image_webp":146,"thumb":147,"thumb_webp":148},"https://cdn.quasa.io/images/news/mVxFOkZTnQE3EIn8OUbEdGCCuY0v57iZ3KJCyz4d.jpg","https://cdn.quasa.io/images/news/mVxFOkZTnQE3EIn8OUbEdGCCuY0v57iZ3KJCyz4d.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/mVxFOkZTnQE3EIn8OUbEdGCCuY0v57iZ3KJCyz4d.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/mVxFOkZTnQE3EIn8OUbEdGCCuY0v57iZ3KJCyz4d.webp",58,{"title":151,"description":152,"slug":153,"created_at":154,"publish_at":155,"formatted_created_at":103,"category":156,"links":157,"view_type":110,"video_url":86,"views":162,"likes":90,"lang":89,"comments_count":90,"is_pinned":112},"AI as a Time Machine: Returning to the Past Through Digital Snapshots","We often romanticize the idea of time travel as something requiring wormholes, Deloreans, or exotic physics.","ai-as-a-time-machine-returning-to-the-past-through-digital-snapshots","2026-04-27T14:00:24.000000Z","2026-05-02T03:49:00.000000Z",{"title":27,"slug":28},{"image":158,"image_webp":159,"thumb":160,"thumb_webp":161},"https://cdn.quasa.io/images/news/FbCs4zDtzIGuZlKl0WigJQAQGqU9nwmh1JWZqRCM.jpg","https://cdn.quasa.io/images/news/FbCs4zDtzIGuZlKl0WigJQAQGqU9nwmh1JWZqRCM.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/FbCs4zDtzIGuZlKl0WigJQAQGqU9nwmh1JWZqRCM.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/FbCs4zDtzIGuZlKl0WigJQAQGqU9nwmh1JWZqRCM.webp",70,[164,176,191,203,218],{"title":165,"description":166,"slug":167,"created_at":168,"publish_at":169,"formatted_created_at":170,"category":171,"links":172,"view_type":110,"video_url":86,"views":175,"likes":88,"lang":89,"comments_count":90,"is_pinned":112},"The Anatomy of an Entrepreneur","Entrepreneur is a French word that means an enterpriser. Enterprisers are people who undertake a business or enterprise with the chance of earning profits or suffering from loss.","the-anatomy-of-an-entrepreneur","2021-08-04T15:18:21.000000Z","2025-12-14T06:09:00.000000Z","14.12.2025",{"title":65,"slug":66},{"image":173,"image_webp":86,"thumb":174,"thumb_webp":174},"https://cdn.quasa.io/images/news/mVsXPTMuHZuI7UXCsENgL1Qwp1uSOf7Rz3uVPMfm.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/mVsXPTMuHZuI7UXCsENgL1Qwp1uSOf7Rz3uVPMfm.webp",72509,{"title":177,"description":178,"slug":179,"created_at":180,"publish_at":181,"formatted_created_at":182,"category":183,"links":184,"view_type":85,"video_url":86,"views":189,"likes":190,"lang":89,"comments_count":90,"is_pinned":112},"Advertising on QUASA","QUASA MEDIA is read by more than 400 thousand people a month. We offer to place your article, add a link or order the writing of an article for publication.","advertising-on-quasa","2022-07-06T07:33:02.000000Z","2025-12-15T17:33:02.000000Z","15.12.2025",{"title":58,"slug":63},{"image":185,"image_webp":186,"thumb":187,"thumb_webp":188},"https://cdn.quasa.io/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.jpg","https://cdn.quasa.io/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.webp",72296,4,{"title":192,"description":193,"slug":194,"created_at":195,"publish_at":196,"formatted_created_at":197,"category":198,"links":199,"view_type":110,"video_url":86,"views":202,"likes":190,"lang":89,"comments_count":90,"is_pinned":112},"What is a Startup?","A startup is not a new company, not a tech company, nor a new tech company. You can be a new tech company, if your goal is not to grow high and fast; then, you are not a startup. ","what-is-a-startup","2021-08-04T12:05:17.000000Z","2025-12-17T13:02:00.000000Z","17.12.2025",{"title":65,"slug":66},{"image":200,"image_webp":86,"thumb":201,"thumb_webp":201},"https://cdn.quasa.io/images/news/EOsQhSW3VXyG7a6NPdE1oZd00xfJXe3bjY5aJGb7.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/EOsQhSW3VXyG7a6NPdE1oZd00xfJXe3bjY5aJGb7.webp",69865,{"title":204,"description":205,"slug":206,"created_at":207,"publish_at":208,"formatted_created_at":209,"category":210,"links":211,"view_type":110,"video_url":86,"views":216,"likes":88,"lang":89,"comments_count":217,"is_pinned":112},"Top 5 Tips to Make More Money as a Content Creator","Content creators are one of the most desired job titles right now. Who wouldn’t want to earn a living online?","top-5-tips-to-make-more-money-as-a-content-creator","2022-01-17T17:31:51.000000Z","2026-01-17T11:30:00.000000Z","17.01.2026",{"title":19,"slug":20},{"image":212,"image_webp":213,"thumb":214,"thumb_webp":215},"https://cdn.quasa.io/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.jpg","https://cdn.quasa.io/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.webp",43733,1,{"title":219,"description":220,"slug":221,"created_at":222,"publish_at":223,"formatted_created_at":224,"category":225,"links":226,"view_type":85,"video_url":86,"views":231,"likes":88,"lang":89,"comments_count":90,"is_pinned":112},"8 Logo Design Tips for Small Businesses","Your logo tells the story of your business and the values you stand for.","8-logo-design-tips-for-small-businesses","2021-12-04T21:59:52.000000Z","2025-05-05T03:30:00.000000Z","05.05.2025",{"title":15,"slug":16},{"image":227,"image_webp":228,"thumb":229,"thumb_webp":230},"https://cdn.quasa.io/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.jpg","https://cdn.quasa.io/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.webp",42729,[233,234,235,236,237,238,239,240,241,242,243,244,245],{"title":23,"slug":24},{"title":47,"slug":48},{"title":55,"slug":56},{"title":43,"slug":44},{"title":51,"slug":52},{"title":31,"slug":32},{"title":35,"slug":36},{"title":27,"slug":28},{"title":19,"slug":20},{"title":15,"slug":16},{"title":58,"slug":63},{"title":11,"slug":12},{"title":65,"slug":66}]