A collection of my latest projects and apps
Talky is an iOS application that records the audio of speeches and gives feedback based on 4 key criteria. A python script hosted on a flask server analyzes the audio for pausing, loudness, accuracy and speed and returns the results for the user to understand and improve on. I developed a fun and interactive chat-based UI for the user to communicate with Talky as well as a community feature for sharing of speeches and results.
WINNER Top 10 Overall
WINNER Most Popular Vote
WINNER Best Microsoft Hack
Synopsys Science Fair 2018
Iris is a device that helps the visually impaired learn Braille effectively and efficiently. Iris is composed of a cardboard frame with 2 3D-printed octagons that rotate to form any character in the braille language. They are controlled by rotational motors through an Arduino board. An accompanying iOS app, designed with a minimalistic UI serves as the controller for the device learning numbers and letters through Speech-to-text. A flask server hosted on Heroku communicates between the app and device to convert spoken characters to degrees of rotation on the device.
WINNER 2nd Place Overall
Guru is a native iOS application that utilizes live-streaming instructional technology to instantaneously connect students with “Gurus” in an effective learning environment. Students and the Guru are synced and placed in a live video call integrated through Twilio to discuss the problem. We developed a custom collaborative whiteboard, allowing both the student and Guru to draw and explain difficult concepts without having to leave the call.
WINNER Top 10 Overall
WINNER $1000 Grant from 1517
WINNER Best Education Hack
Synopsys Science Fair 2017
MedicAI is an SMS-based platform focused on bringing quick and accurate medical diagnoses to 3rd world countries. A user can either send an image of the disease or a text of the symptoms they face. I wrote a classification algorithm for common visible ailments and a custom NLP algorithm to that extracted symptoms based on value association and frequency. Once the disease had been classified, I utilized location analysis to build a heatmap of location-specific outbreaks and further improve my accuracy. After cross validation, the final service had an accuracy of 90% with images and 94% with text.
WINNER Grand Prize Winner - $1000
PinPoint is an android application that generates the fastest path to grab all your items in a grocery store. My team and I created a mock bitmap of an actual store with 0’s representing free space and 1’s representing obstacles. Importing the user’s shopping list we figured out the items locations on the bitmap/2D array. We then utilized the A* algorithm on the bitmap matrix to find the best path between the individual points. The android application has an 8-Bit UI with animating lines, pulsating items and disappearing pathways as the user travels from item to item.
WINNER Best Android App
ICON is an iOS application focused on making fashion accessible to everyone. Using a convolutional neural network, we wrote an image classifier with 10 different categories to document and record the user’s closet. The user selects and stores their outfit everyday; If someone sees their outfit and likes it, they can save that outfit and all nearby outfits with a tap of a button. The outfit discovery feature is based on a location proximity of 10 meters. We also utilized frequency analysis on user outfits in an area to predict current and future fashion trends.
WINNER Project YX Fashion Prize
60Seconds is an iOS Application that calls the user every day at 9 PM to record a 60-second description of what happened throughout the day. The application acts as an online journal for the user; We utilized Twilio to make the recurring call and stored the audio in Firebase. We designed a custom calendar for the iOS Application that stored both the audio of the recording and the transcribed version. By running sentiment analysis, we determined if the user was happy or not on that day and classified it accordingly. A Flask server hosted on Heroku was used to call the user and analyze the recording.
WINNER First Place Overall
Rhythm is a web application that converts direct english sentences and commands into algorithms executable for the stock market. I utilized Natural Language Processing to analyze the command, remove stopwords and comprehend technical terms to generate the investment command. I then leveraged Quantopian and Zipline to fetch historical stock data and run the generated stock algorithm against it. Once the results came in, I build a data visualization dashboard with MatPlotLib to view and predict how their algorithm did in the past and learn how it would perform in the present. The entire website was built using React and Node.JS.