Prashant Mathur retweeted
Last quarter I rolled out Microsoft Copilot to 4,000 employees.
$30 per seat per month.
$1.4 million annually.
I called it "digital transformation."
The board loved that phrase.
They approved it in eleven minutes.
No one asked what it would actually do.
Including me.
I told everyone it would "10x productivity."
That's not a real number.
But it sounds like one.
HR asked how we'd measure the 10x.
I said we'd "leverage analytics dashboards."
They stopped asking.
Three months later I checked the usage reports.
47 people had opened it.
12 had used it more than once.
One of them was me.
I used it to summarize an email I could have read in 30 seconds.
It took 45 seconds.
Plus the time it took to fix the hallucinations.
But I called it a "pilot success."
Success means the pilot didn't visibly fail.
The CFO asked about ROI.
I showed him a graph.
The graph went up and to the right.
It measured "AI enablement."
I made that metric up.
He nodded approvingly.
We're "AI-enabled" now.
I don't know what that means.
But it's in our investor deck.
A senior developer asked why we didn't use Claude or ChatGPT.
I said we needed "enterprise-grade security."
He asked what that meant.
I said "compliance."
He asked which compliance.
I said "all of them."
He looked skeptical.
I scheduled him for a "career development conversation."
He stopped asking questions.
Microsoft sent a case study team.
They wanted to feature us as a success story.
I told them we "saved 40,000 hours."
I calculated that number by multiplying employees by a number I made up.
They didn't verify it.
They never do.
Now we're on Microsoft's website.
"Global enterprise achieves 40,000 hours of productivity gains with Copilot."
The CEO shared it on LinkedIn.
He got 3,000 likes.
He's never used Copilot.
None of the executives have.
We have an exemption.
"Strategic focus requires minimal digital distraction."
I wrote that policy.
The licenses renew next month.
I'm requesting an expansion.
5,000 more seats.
We haven't used the first 4,000.
But this time we'll "drive adoption."
Adoption means mandatory training.
Training means a 45-minute webinar no one watches.
But completion will be tracked.
Completion is a metric.
Metrics go in dashboards.
Dashboards go in board presentations.
Board presentations get me promoted.
I'll be SVP by Q3.
I still don't know what Copilot does.
But I know what it's for.
It's for showing we're "investing in AI."
Investment means spending.
Spending means commitment.
Commitment means we're serious about the future.
The future is whatever I say it is.
As long as the graph goes up and to the right.
Prashant Mathur retweeted
Language Technologies Research Centre (LTRC) is celebrating 25 years of language research. Details at ltrc.iiit.ac.in/silver-jubil…
Prashant Mathur retweeted
RLHF is a popular method. It makes your human eval score better and Elo rating 🚀🚀.
But really❓Your model might be “cheating” you! 😈😈
We show that LLMs can learn to mislead human evaluators via RLHF.
🧵below
Prashant Mathur retweeted
Today, Amazon announced its Trusted AI Challenge, which involves university students competing to securely advance large language models (LLMs) that code, and where $700,000 in cash prizes will be allocated across the top four performing teams. Learn more about the challenge and how to apply: amazon.science/trusted-ai-ch… #ResponsibleAI #GenAI
Prashant Mathur retweeted
What do World Cup victories mean to us? I don’t mean the players; we all know the answer to that.
But what does it mean to us, the fans, the ones who do nothing?
I can tell you what it means to me.
They say that before one dies, the moments that mattered in our life flash before our eyes.
World Cup victories will be in my final kaleidoscope.
I will see Kapil Dev running back on the green of Lords, my little boy’s heart in my mouth, taking a catch that changes the history of a nation. I will see Misbah, with the Cup in hand, hand it over to the gentle dollies of Joginder Sharma, and I will see Dhoni, of course, sending the ball into the night sky. To that now, add Suryakumar Yadav, balancing himself on the line between victory and defeat, pivoting the game on a knife’s edge back to India.
I will see them all, and I will see more.
I will see who I was with when those moments came to pass.
My father aging from 83 to 2024 in the images in my mind, and a new entrant to those memories, my daughter in 2024. I will see myself, too, reflected in the echoes of how I felt, from the boy wide-eyed in wonder in 83, hoping the power doesn’t go out again during the telecast to the young man in another country in 07 and 11 and now back in my own, this time a father, four different me-s in shape, size and mind, tied together through time simply by a chain of indescribable happiness, the happiness made happier by how rare these moments of World Cup victory are, dots on a timeline plagued by defeat and disappointment.
But why this happiness for the achievements of a group of strangers, the cynical older me asks, one who play for a club called BCCI? Why bother?
It’s because it’s these moments that tie our happiness to billions of others. It’s when the trajectories of our lives all meet at a common emotion at the exact same time before they diverge again in random ways, making us aware, even if for a fleeting moment, of a simple yet forgotten truth.
We are not alone.
Prashant Mathur retweeted
📣 📣 📣 New instruction-tuned LLM! 📣 📣 📣
Today, we announce an initial release of "Airavata", an instruction-tuned LLM for Hindi.
Blog: ai4bharat.github.io/airavata…
Model: huggingface.co/ai4bharat/Air…
Datasets: huggingface.co/datasets/ai4b…
(1/N)
Prashant Mathur retweeted
🚨 🔔 Paper alert in Speech Translation 🔔🚨
I'm super excited to release our accepted paper (@EMNLP-main) about dual speaker-turn-aware speech transcription and translation for conversational speech!
abs: arxiv.org/abs/2311.00697
@AmazonScience @Idiap_ch @EPFL_en
Prashant Mathur retweeted
Maxwell's place in history just got guaranteed. It has to be the greatest white ball innings played
Prashant Mathur retweeted
Dear ACL community, ACL is considering multiple proposals to change its anonymity period policy. It seeks immediate feedback from the community about the proposed changes. Please add your voice until Friday, September 22nd (AOE): aclweb.org/portal/content/su… #NLProc
Prashant Mathur retweeted
Sure, ChatGPT is cool, but do you know what's cooler?
Making language technologies happen, for communities who did not have access to them.
@iamsikasote and I (but really mostly Claytone) have been on a two-year quest to create language technologies for Zambia 🇿🇲.
Thread⬇️
Prashant Mathur retweeted
We’re announcing Amazon Bedrock—giving customers the easiest way to build and scale generative AI applications with access to the leading foundation models including @AnthropicAI, @AI21Labs, @StabilityAI and Amazon Titan FMs. Choice rules!
aws.amazon.com/blogs/machine…
Prashant Mathur retweeted
Improving Machine Translation Evaluation with COMET v2.0 - Say Goodbye to Outdated Metrics! 🌟
With all the hype around GPT-4 is more important than ever to have reliable evaluation metrics and methodologies. That why we are excited to release COMET v2.0: resources.unbabel.com/r-d-bl…
Prashant Mathur retweeted
Happy to share my @AmazonScience internship work:
📜arxiv.org/abs/2302.12979
will be used in iwslt.org/2023/dubbing
Given a video in lang.X, we jointly optimize translation & durations of translations to generate more isochronic speech (time-aligned w/original) in lang.Y!
👇🧵
Prashant Mathur retweeted
Immigration News!
This week, at a roundtable for US-India relations hosted by Ajay (@ajainb), Jen Sudweeks, who leads visa ops for the US Embassy in Delhi, said..
The US State Dept pilot program to stamp H-1Bs within the US will start by END OF SUMMER '23.
🧵 More News
1/4
Prashant Mathur retweeted
Dear ACL members: We appreciate that if you do not wish to receive email for ACL portal, please simply unsubscribe. Marking emails sent out from our portal as spam or abuse would lead to the suspension of our account. (1/2) #NLProc
Prashant Mathur retweeted
Our paper has been accepteted to @eaclmeeting (Main Track)!! 🥳
Many thanks to my co-authors @_mathur and @evahasler and the rest of the Doubtfire team @AmazonScience!
Read our paper if you are interested in idiom translation!
#eacl2023
Happy to share my @AmazonScience internship work: "Automatic Evaluation and Analysis of Idioms in NMT".
With @_mathur and @evahasler.
📜 arxiv.org/abs/2210.04545
+ Automatic metric for literal translation errors (LitTER)
+ How (random-vs-pretrained) models translate idioms
👇🧵
Prashant Mathur retweeted
Not from Twitter, but I've also been part of large-scale layoffs, so I'm looking for a new machine learning / data science position, esp. in NLP
Lots of experience in both academic & industry settings
I live in France so I'm after jobs that can be done from here
please retweet
Prashant Mathur retweeted
Reminder that the deadline for the #AmazonResearchAwards fall 2022 call for proposals is Oct. 19. Learn more about each CFP, and how to apply. ⬇️
Prashant Mathur retweeted
We just want to state that the #NLProc community need to care (more) about our languages. Lets push harder to get a established track for language diversity in #NLP conferences. We have the same colonial past as our brothers @MasakhaneNLP . Lets push it together!
Prashant Mathur retweeted
Happy to share that our work on document-level MT metrics is available!
w/ Brian Thompson, @_mathur @marcfede
📜arxiv.org/abs/2209.13654
Instead of inventing new document-level metrics, we simply extend existing MT metrics to the document level!




























