how to use
pipfy.captions is an accessibility hack to create a captioning feed of your audio input. only works in google chrome. it uses the google speech-to-text API to generate automatic subtitles.
you can create a floating subtitle bar that hovers over active windows on your desktop. adjust the bar and text to your needs. if you switch languages you may have to restart the process for the API to understand you.
you can also share your subtitles as a live feed to a private peer-to-peer session so that others may read in their browser what you are saying.
reroute audio in your operating system (or use a virtual cable) to create subtitles for any sound source on your computer.
exporting the text (with time stamps) is currently disabled. you can enable it, if you know HTML and CSS or wait for us to improve usability.
automatic captioning is at best 90% accurate and it works only 90% of the time. please adjust your expectations. also the API is a bit finicky. we'll do what we can to improve the usability on our end, but ultimately we rely on a third party API to improve accuracy over time. as for privacy: we encrypt the text end-to-end, but the speech recognition happens on google servers.
thanks. practice solidarity, stay positive. you got this.
made with lots of care but too little time from your friendly design lab at
pxi|lab (currently in german only).