Prashant Mathur (@_mathur) header
Prashant Mathur (@_mathur) profile picture

putting random stuff out there

New York, NY
Joined July 2009
Prashant Mathur retweeted
Last quarter I rolled out Microsoft Copilot to 4,000 employees. $30 per seat per month. $1.4 million annually. I called it "digital transformation." The board loved that phrase. They approved it in eleven minutes. No one asked what it would actually do. Including me. I told everyone it would "10x productivity." That's not a real number. But it sounds like one. HR asked how we'd measure the 10x. I said we'd "leverage analytics dashboards." They stopped asking. Three months later I checked the usage reports. 47 people had opened it. 12 had used it more than once. One of them was me. I used it to summarize an email I could have read in 30 seconds. It took 45 seconds. Plus the time it took to fix the hallucinations. But I called it a "pilot success." Success means the pilot didn't visibly fail. The CFO asked about ROI. I showed him a graph. The graph went up and to the right. It measured "AI enablement." I made that metric up. He nodded approvingly. We're "AI-enabled" now. I don't know what that means. But it's in our investor deck. A senior developer asked why we didn't use Claude or ChatGPT. I said we needed "enterprise-grade security." He asked what that meant. I said "compliance." He asked which compliance. I said "all of them." He looked skeptical. I scheduled him for a "career development conversation." He stopped asking questions. Microsoft sent a case study team. They wanted to feature us as a success story. I told them we "saved 40,000 hours." I calculated that number by multiplying employees by a number I made up. They didn't verify it. They never do. Now we're on Microsoft's website. "Global enterprise achieves 40,000 hours of productivity gains with Copilot." The CEO shared it on LinkedIn. He got 3,000 likes. He's never used Copilot. None of the executives have. We have an exemption. "Strategic focus requires minimal digital distraction." I wrote that policy. The licenses renew next month. I'm requesting an expansion. 5,000 more seats. We haven't used the first 4,000. But this time we'll "drive adoption." Adoption means mandatory training. Training means a 45-minute webinar no one watches. But completion will be tracked. Completion is a metric. Metrics go in dashboards. Dashboards go in board presentations. Board presentations get me promoted. I'll be SVP by Q3. I still don't know what Copilot does. But I know what it's for. It's for showing we're "investing in AI." Investment means spending. Spending means commitment. Commitment means we're serious about the future. The future is whatever I say it is. As long as the graph goes up and to the right.
5,081
25,171
5,918
169,584
26,265,027
Language Technologies Research Centre (LTRC) is celebrating 25 years of language research. Details at ltrc.iiit.ac.in/silver-jubil…
2
4
333
Prashant Mathur retweeted
RLHF is a popular method. It makes your human eval score better and Elo rating 🚀🚀. But really❓Your model might be “cheating” you! 😈😈 We show that LLMs can learn to mislead human evaluators via RLHF. 🧵below
17
86
32
529
156,530
Prashant Mathur retweeted
Today, Amazon announced its Trusted AI Challenge, which involves university students competing to securely advance large language models (LLMs) that code, and where $700,000 in cash prizes will be allocated across the top four performing teams. Learn more about the challenge and how to apply: amazon.science/trusted-ai-ch… #ResponsibleAI #GenAI
4
19
6
48
28,639
Prashant Mathur retweeted
What do World Cup victories mean to us? I don’t mean the players; we all know the answer to that. But what does it mean to us, the fans, the ones who do nothing? I can tell you what it means to me. They say that before one dies, the moments that mattered in our life flash before our eyes. World Cup victories will be in my final kaleidoscope. I will see Kapil Dev running back on the green of Lords, my little boy’s heart in my mouth, taking a catch that changes the history of a nation. I will see Misbah, with the Cup in hand, hand it over to the gentle dollies of Joginder Sharma, and I will see Dhoni, of course, sending the ball into the night sky. To that now, add Suryakumar Yadav, balancing himself on the line between victory and defeat, pivoting the game on a knife’s edge back to India. I will see them all, and I will see more. I will see who I was with when those moments came to pass. My father aging from 83 to 2024 in the images in my mind, and a new entrant to those memories, my daughter in 2024. I will see myself, too, reflected in the echoes of how I felt, from the boy wide-eyed in wonder in 83, hoping the power doesn’t go out again during the telecast to the young man in another country in 07 and 11 and now back in my own, this time a father, four different me-s in shape, size and mind, tied together through time simply by a chain of indescribable happiness, the happiness made happier by how rare these moments of World Cup victory are, dots on a timeline plagued by defeat and disappointment. But why this happiness for the achievements of a group of strangers, the cynical older me asks, one who play for a club called BCCI? Why bother? It’s because it’s these moments that tie our happiness to billions of others. It’s when the trajectories of our lives all meet at a common emotion at the exact same time before they diverge again in random ways, making us aware, even if for a fleeting moment, of a simple yet forgotten truth. We are not alone.
43
116
23
452
30,078
Prashant Mathur retweeted
📣 📣 📣 New instruction-tuned LLM! 📣 📣 📣 Today, we announce an initial release of "Airavata", an instruction-tuned LLM for Hindi. Blog: ai4bharat.github.io/airavata… Model: huggingface.co/ai4bharat/Air… Datasets: huggingface.co/datasets/ai4b… (1/N)
8
83
15
362
51,636
Prashant Mathur retweeted
🚨 🔔 Paper alert in Speech Translation 🔔🚨 I'm super excited to release our accepted paper (@EMNLP-main) about dual speaker-turn-aware speech transcription and translation for conversational speech! abs: arxiv.org/abs/2311.00697 @AmazonScience @Idiap_ch @EPFL_en
2
3
1
47
5,386
Prashant Mathur retweeted
Maxwell's place in history just got guaranteed. It has to be the greatest white ball innings played
668
5,590
198
65,165
1,334,744
Prashant Mathur retweeted
Dear ACL community, ACL is considering multiple proposals to change its anonymity period policy. It seeks immediate feedback from the community about the proposed changes. Please add your voice until Friday, September 22nd (AOE): aclweb.org/portal/content/su… #NLProc
5
188
21
269
115,998
Sure, ChatGPT is cool, but do you know what's cooler? Making language technologies happen, for communities who did not have access to them. @iamsikasote and I (but really mostly Claytone) have been on a two-year quest to create language technologies for Zambia 🇿🇲. Thread⬇️
1
17
1
110
8,047
Prashant Mathur retweeted
Improving Machine Translation Evaluation with COMET v2.0 - Say Goodbye to Outdated Metrics! 🌟 With all the hype around GPT-4 is more important than ever to have reliable evaluation metrics and methodologies. That why we are excited to release COMET v2.0: resources.unbabel.com/r-d-bl…
4
15
1
39
3,034
Happy to share my @AmazonScience internship work: 📜arxiv.org/abs/2302.12979 will be used in iwslt.org/2023/dubbing Given a video in lang.X, we jointly optimize translation & durations of translations to generate more isochronic speech (time-aligned w/original) in lang.Y! 👇🧵
2
8
75
8,806
Prashant Mathur retweeted
Immigration News! This week, at a roundtable for US-India relations hosted by Ajay (@ajainb), Jen Sudweeks, who leads visa ops for the US Embassy in Delhi, said.. The US State Dept pilot program to stamp H-1Bs within the US will start by END OF SUMMER '23. 🧵 More News 1/4
25
90
22
821
384,254
Prashant Mathur retweeted
Dear ACL members: We appreciate that if you do not wish to receive email for ACL portal, please simply unsubscribe. Marking emails sent out from our portal as spam or abuse would lead to the suspension of our account. (1/2) #NLProc
5
11
41
18,496
Prashant Mathur retweeted
Our paper has been accepteted to @eaclmeeting (Main Track)!! 🥳 Many thanks to my co-authors @_mathur and @evahasler and the rest of the Doubtfire team @AmazonScience! Read our paper if you are interested in idiom translation! #eacl2023
Happy to share my @AmazonScience internship work: "Automatic Evaluation and Analysis of Idioms in NMT". With @_mathur and @evahasler. 📜 arxiv.org/abs/2210.04545 + Automatic metric for literal translation errors (LitTER) + How (random-vs-pretrained) models translate idioms 👇🧵
4
7
50
6,229
Prashant Mathur retweeted
Not from Twitter, but I've also been part of large-scale layoffs, so I'm looking for a new machine learning / data science position, esp. in NLP Lots of experience in both academic & industry settings I live in France so I'm after jobs that can be done from here please retweet
4
57
2
94
Prashant Mathur retweeted
Reminder that the deadline for the #AmazonResearchAwards fall 2022 call for proposals is Oct. 19. Learn more about each CFP, and how to apply. ⬇️

3
3
Prashant Mathur retweeted
We just want to state that the #NLProc community need to care (more) about our languages. Lets push harder to get a established track for language diversity in #NLP conferences. We have the same colonial past as our brothers @MasakhaneNLP . Lets push it together!
Prashant Mathur retweeted
Happy to share that our work on document-level MT metrics is available! w/ Brian Thompson, @_mathur @marcfede 📜arxiv.org/abs/2209.13654 Instead of inventing new document-level metrics, we simply extend existing MT metrics to the document level!
1
13
1
63