• Daily Zaps
  • Posts
  • ChatGPT can now see, hear, and speak

ChatGPT can now see, hear, and speak

AI tool for genetic mutations, Amazon and Anthropic, Spotify voice translator, and more

Welcome to Daily Zaps — Here’s what we got for you today: 🙌

  • 👀 ChatGPT can now see, hear, and speak

  • 🧬 AI tool classifies genetic mutations

  • 🤝 Amazon to invest $4 billion in Anthropic

  • 🗣️ Spotify AI voice translation feature

  • 🔗 Other tech news

Let’s get right into it!

ChatGPT can now see, hear, and speak

OpenAI has introduced new features for ChatGPT, including the ability for users to engage in voice conversations with the AI-powered chatbot. This feature allows users to have interactive voice interactions with ChatGPT, similar to Amazon's Alexa or Apple's Siri voice assistants. Users can request things like bedtime stories for their families or settle dinner table debates through voice conversations with ChatGPT. In a demo, ChatGPT was shown generating a story about a "super-duper sunflower hedgehog named Larry" and responding to questions about the story, showcasing its human-like voice capabilities. OpenAI's text-to-speech model powers ChatGPT's voice capabilities, and the company collaborated with professional voice actors to create five different voices for the chatbot.

Additionally, OpenAI is rolling out a feature that allows ChatGPT to respond to prompts featuring images. Users can take a picture of their fridge's contents and ask ChatGPT to help them come up with a meal plan using the available ingredients. The chatbot can also focus on specific parts of an image using a drawing tool in the app. These new features will be available within the next two weeks for paying subscribers of ChatGPT's Plus and Enterprise services, with subscriptions for the Plus service priced at $20 a month.

AI tool classifies genetic mutations

AlphaMissense, an AI tool developed using AlphaFold, can classify the effects of 71 million 'missense' mutations. These mutations involve single-letter changes in DNA that affect protein function. AlphaMissense accurately categorized 89% of these mutations as likely pathogenic or benign, outperforming human experts who have only confirmed 0.1% of them. This AI tool accelerates research in genetics, making it easier to prioritize resources for studying diseases. It's freely available to researchers, offering a substantial resource for understanding genetic diseases.

From Our Partners

Here’s how it works:

  • 📖 Toss in your company website, PDFs, or even a YouTube video, and watch as Dropchat works its magic and turns your content into an AI powered sidekick.

  • 🔗 Share the chatbot via code snippet or URL with students, employees, customers, and partners.

  • 🌐 Add the chatbot to websites for 24/7 AI powered sales, marketing, and tech support.

Amazon to invest $4 billion in Anthropic

Amazon is set to invest up to $4 billion in Anthropic as part of its strategy to compete with tech giants like Microsoft, Meta, Google, and Nvidia in the rapidly growing AI sector. Initially, Amazon will invest $1.25 billion for a minority stake in Anthropic, with an option to increase its investment to the total of $4 billion. Anthropic, which already counts Google as an investor, recently launched its premium subscription plan for chatbot Claude 2 and plans to develop an advanced AI model, referred to as "Claude-Next," with capabilities ten times greater than today's most powerful AI.

However, Anthropic anticipates a substantial investment of one billion dollars over the next 18 months to achieve this goal. Amazon's investment not only brings substantial financial backing but also provides compute power for AI model development and access to a broad customer base. Anthropic will rely on Amazon's AWS cloud services for mission-critical tasks, including safety research and future model development. This collaboration is expected to enhance customer experiences and leverage AWS's capabilities, such as Amazon Bedrock and AWS Trainium, to build generative AI applications.

Spotify AI voice translation feature

Spotify is introducing an AI-powered voice translation feature that allows podcasters to instantly translate their content into other languages using their own voice. The platform has collaborated with select podcasters to initially translate English-language episodes into Spanish, with plans to add French and German translations in the near future. Spotify's translation feature is underpinned by OpenAI's Whisper, which not only transcribes English speech but also translates languages into English. Additionally, it goes beyond text-to-speech translation by reproducing the podcast in a synthesized version of the podcaster's own voice, enhancing authenticity for global listeners.

Spotify has not disclosed specific plans for wider availability or expansion, possibly due to safety and privacy considerations associated with such AI-driven capabilities.

In case you’re interested — we’ve got a bunch of cool AI tools listed over at Daily Zaps AI hub. If you have any cool tools to share, feel free to submit them or get in touch with us by replying to this email.

Other tech and news we thought were cool 🔗

Newsletters from our friends

WiFi WeeklyKeep up-to-date on WiFi technology and trends with our 3-minute weekly email.

Refer Daily Zaps

Can you do me a solid and refer a buddy, colleague, or family member to Daily Zaps? As a thank you, I'll send you an Airtable list of over 170 AI-focused startups complete with links to their sites, founder names, funding amounts, investors, and all that good stuff.

If you don’t have anyone to refer you can still help by doing below.

  • Reply to this email with a simple “yes” or “no”… LOL … so that I know people are reading this tiny newsletter on the Internet.

  • Desktop readers, drag newsletter email to your primary inbox. This will make sure you don’t miss any issues.

  • On your phone? No problem. Hit the 3 dots at top right corner, click "Move to" then "Primary."

  • Apple mail users: Tap on our email address at the top of this email (next to "From:" on mobile) and click “Add to VIPs”

Pssst….check out what readers are saying about Daily Zaps 🥰

How much did you enjoy this email?

Login or Subscribe to participate in polls.

Peace out,

Daily Zaps Team