[WIP] SOFTWARE DEVELOPMENT ENGINEER
Overview:
TBA
Overview:
- My current job entails collecting raw telemetry data from thermostats, outlets, sensors, and other various devices that we install into hotels, universities, hospitality places, etc, and I store that data into various databases after consolidating and transforming that telemetry data into scalar metrics.
- After that, I write aggregation functions to further transform the data into insightful actionable metrics that can be displayed in graphs and charts. It's all about finding patterns, and performing predictive analysis on the data so that we can send notifications and alerts to hotel management and property engineers, so that they can predict problems and visualize patterns to optimize their infrastructures and energy savings.
- Additionally, our web application allows our customers to control the various devices at their properties, and set schedules to automate the states of their devices to maximize utility.
- Languages: Python, JavaScript, PHP, SQL
- Frameworks/Technologies: AWS, Flask, RabbitMQ, Celery, Ext JS, Node.js, jQuery, HTML, CSS
- Database/Storage Systems: MySQL, DynamoDB, S3, Redshift, Redis
- Version Control: GitLab, GitHub
- Operating Systems: Linux (Debian), Windows
- Knowledge and experience with the AWS services: AWS IoT, Kinesis Streams, Kinesis Firehose, Lambda, DynamoDB, Redshift, S3, Elastic Beanstalk, CloudFormation, SQS, SNS, SES, ElastiCache, CloudWatch, IAM, Route53.
- Architected and developed an auto-scaling data pipeline in the cloud, that ingests thousands of telemetry data points per minute using Python and all the above AWS services.
- Scripted automated analysis and aggregation tasks with Python and Pandas, and developed a RESTful API with Python and Flask to expose the resulting data sets via a web application.
- Constructed an authorization and permissions management system to facilitate access of the web application.
- Designed and implemented schemata in DynamoDB and MySQL to support functionality of various web applications.
- Developed a platform, with RabbitMQ, Celery, Python, and the AWS IoT service, to enable thousands of Raspberry Pis to communicate, and transmit securely, telemetry data to the data pipeline specified above.
TBA
Last edited: