Joshua Sorenson
Engineering Leader in Bay Area, He/Him
Open to exploring new opportunities, contract or otherwise.
Work Experience
Acquired by LexisNexis Risk Solutions in 2023
I oversaw Cloud Operations, Security Engineering, Backend systems, and Engineering Productivity domains.
- Write internal tools, optimize existing codebases, investigate difficult to debug bugs across all teams
- Managed a small team of cloud infrastructure engineers
- Optimized our cloud service architecture to reduce cost
- Responsible for our SOC2 and HIPAA compliance programs
- Refined and led incident response process
- Mentored and up-leveled engineers and jr. managers
"Intelligent security for your smart home
Whether it’s your robot vacuum, or your security camera, all smart devices constantly collect and share your data.
Do you know who your private data is being shared with, if it's going to the right places, or being compromised?
Get full vision and control over your data, your devices, and your smart home with Everything Set."
- Responsible for developing security researcher program and disclosure framework
- Improved packet capture and spoofing performance and stability
- Provided strategic guidance for the company's technical roadmap and ML approach
I make things for people and companies via short term or long term engagements.
Highlighted projects:
- Consulting engagements to help companies institute DevOps philosophies and build platform engineering organizations.
- Improved the stability and performance of an embedded linux system, eventually building a new image from
the ground up with only necessary pieces for their device, at an IoT-based workplace intelligence platform company (Embedded linux, systems
engineering, security engineering) - Design and develop the product and infrastructure from the ground up for a startup providing HR tools for
small businesses (Python, Django, HTML/CSS/JS) - Crowdfunding ecosystem scraping, statistics, analytics, and email alerts (Ruby, Rails, Sidekiq)
- Assisted in transitioning a social networking app's core data storage technology from MongoDB to Postgresql
- Custom software development to better track potential candidates and improve recruiter workflows for a
technical recruitment firm (Python) - Ported a legacy PHP code base to Python/Django for a daily deals company
eero was acquired by Amazon in 2019
- Managed the Data Engineering/Data Science/Data Infra team, providing critical insights to firmware, product, business, and manufacturers teams.
- Oversaw consumer facing realtime data features for eero plus.
- Explored device identification and automated troubleshooting machine learning systems.
- Partnered with Security and helped develop data compliance programs (CCPA, GDPR, etc...)
- Vocal advocate for user data privacy.
- Our team built systems to handle 200k/rps, TBs of data generated per day, and strict uptime requirements, using systems like: Redshift, HBase, Kafka, Scala, Pinot, Airflow, k8s
- Created data streaming tools and frameworks enabling realtime insight into fleet health, and unlocking new product possibilities
- Lead the initiative to containerize and orchestrate all non-databricks jobs and services onto Kubernetes.
- Mentored teammates, and provided management with technical insights and direction.
Technologies I loved: kafka, golang, scala, k8s, AWS, Databricks, python
Realtime analytics on IoT data streams using online machine learning, complex event processing, and simple pattern matching techniques.
Juggled the constantly shifting needs of our technology, customers, timelines
- Built our software platform from the ground up, working on all aspects of the stack. Our technologies
included: Python, Django, Flask, Golang, Apache Storm, Kafka, Postgresql, Cassandra, Elasticsearch, SaltStack, Zabbix,
Docker, and Kubernetes - Engineered our customer facing endpoints to minimize data loss during outages and failures (Python/Flask)
- Ensured our core data processing pipeline was idempotent, lowlatency, and scalable (Storm, Cassandra,
Elasticsearch) - Designed and developed custom CEP software in that easily handled 120k/s messages (Golang, Kafka)
- Created many internal tools, reports, and alerting systems (Golang)
- Utilized our container orchestration software to create easy deployments, automated scaling, and fast
response times for outages (Zabbix, Docker, Kubernetes)
Was acquired by Samsung in 2016
Design and deliver custom mobile and desktop software applications:
Projects included:
- custom web, mobile app, and video scraping
- realtime traffic analysis for arbitrary app store applications (Android and iOS)
- infrastructure management and improvement projects
- custom Ruby Motion iOS app development
Build, deploy, and maintain IT self service services for engineering
• Designed and engineered a modern, self service, cross platform system imaging solution
• Assisted the InfoSec team with incident response and mitigation
• Worked to improve performance of critical infrastructure
• Expanded system inventory and control systems
• Tuned of monitoring systems, improving signal to noise ratio
• Worked closely with Tegra team to provide system engineering support
• Participated in a regular on-call rotation.
Primarily responsibilities were: development of automated configuration and deployment systems, expanding and improving crawling infrastructure and codebase, and managed production system health.
Some additional responsibilities included:
• Ported existing legacy production code to more modern platforms
• Created software tools to streamline Operations, Engineering, and IT workflows
• Designed and developed new automated code deployment systems
• Expanded in-house configuration management tools
• Transitioned to and managed a new monitoring system for all production machines
• Securely segmented resources and granted access for remote outsource teams to internal source trees and tools
• Analyzed and improved performance of various infrastructure e.g. Python data processing pipeline, database servers, search cluster index distribution and synchronization
• First responder duties on a 24x7x365 basis
• Created additional dashboards to visualize performance metrics.
• Developed job workflow processing for various new languages and locales.
• Developed internal tools to catalog hardware and software across all servers and workstations distributed across all client networks. (.NET/C#)
• Created and integrated custom tools into Connectwise database to improve help desk efficiency. (.NET/C#)
• Solely responsible for maintaining company web servers.
• Performed phone support for hundreds of employees across all client companies.
Provided systems support and tool development
• Configuration and maintenance of client machines, web sites, and services.
• Development of new internal software and tools to manage customer support interactions.
• Configuration and maintenance of Nagios monitoring systems.
• Sourced new clients and provided customer support.