ikigomu
394 FOLLOWERS
A Data Science, NLP and personal blog by Matthew Ruttley. Ikigomu is a new Japanese Language learning website that uses NLP and Data Mining techniques to personalize your studies!
ikigomu
5y ago
Data teams are very hard to hire. Engineers are low in supply and high in demand, resumés are difficult to vet without time-consuming phone/coding screens, and often without FAANG’s resources it can be hard to find people as passionate as you are about your product. As the hiring manager, you may be lucky enough to afford the services of a professional recruiter. However, often the recruiters send you completely unsuitable candidates.
A very friendly recruiter I know in NYC and I had coffee the other day to discuss these industry issues. We agreed that it would be useful if we defined what mak ..read more
ikigomu
5y ago
Data at Frame.io
At a growing startup like Frame.io, we have a huge volume of data coming in — over 67 million events per month. Efficient analysis is crucial to remain the market leader, and we use a whole host of tools:
GUIs like Looker, Redash and PSequel
Internal analytics and query parallelization microservices
Custom AI slackbots we’ve built for spam/intrusion detection and sales lead spotting
This means that our data warehouse is being constantly hit by tons of queries — both on Cron schedules and from employees exploring our datasets.
Volume issues
Managing this volume of queries can b ..read more