Profiles search
🐆 Douglas Muth 🐆
Splunk Architect and Software Engineer
Philadelphia, PA, United States
Details
Experience:
Current tasks include data engineering, automation, analytics, and tooling for our threat analytics platform. My work also includes reducing sources of toil (actions which are repetitive, complex, and prone to human error) in order to decrease downtime and MTTR, as well as make the platform more resilient to unexpected events.
2019 : Present
Comcast
Senior Cybersecurity Engineer
- Architected and implemented the 7th largest DMARC report generator in the world, generating DMARC reports for over 30,000 domains each day.
- Continued to grow our Splunk cluster for data processing of logs from Cocmast.net mail servers and other sources. Expanded capacity to 7 TB/day of data and ~300,000 events per second. Also increased retention of all logs into the 100s of TB range.
- Created the Spam Repository Database microservice to handle spam complaints from users. Written in Node.js, this microservice handles 100s of reports a second during peak times.
- Architected use of 100+ Heavy Forwarders to receive traffic and filter out what was unnecessary, saving the organization many thousands of dollars a year in Splunk licensing fees. All sources of data had Heavy Forwarders in at least 3 different datacenters to ensure availability in case of an outage. All communication from Heavy Forwarders to Indexers is secured with SSL.
- Moved entire Splunk infrastructure (several Search Heads, dozens of Indexers, and dozens more Heavy Forwarders) into Puppet to centralize management of those machines. With Puppet, I proceeded to enable performance monitoring on all machines and create iptables rules to enforce organizational policy (such as limiting what Deployment Servers HFWs could talk to).
- Architected an upgrade of our entire Splunk cluster containing multiple search Heads and dozens of Indexers from 5.0.6 to 6.3. In the process, created a Clustered Search Head group to ensure availability in case one machine goes down.
Prior assignments at Comcast include serving on the Residential Anti-Abuse Team for the @Comcast.net SMTP servers, and being the Lead Engineer on the Signature Support Team.
2013 : 2019
Comcast Cable
Senior Engineer and Splunk Architect
Anthrocon, Inc. is a 501(c)7 non-profit registered in the Commonwealth of Pennsylvania. Our annual convention has grown from 1,900 attendees in 2003 to 9,300 in 2019. We have had a cumulative economic impact of over $50 million in Pittsburgh since moving the convention there in 2006.
From 2015 to 2017, I was the organization's Technology Director, largely responsible for our online presence, including a website, and a social media channel on virtually every social network, including Twitter, where we have over 45,000 followers.
Starting in 2008, I created the convention's social media assets. I grew our follower base from zero to our current numbers : 45,000 followers on Twitter, and a combined 90,000 followers across all social media platforms and groups.
From 2003 to 2015 I was the Operations Director, responsible for the Operations Department, with a staff of 6 to 8 individuals reporting to me. This department is responsible for logistics and support of other departments and volunteers before, during, and after our annual conference in Pittsburgh, PA.
2003 : 2018
Anthrocon, Inc
Board Of Directors
The Save Ardmore Coalition is a 501(c)4 civic group based out of Ardmore, PA. It was originally founded to fight a bogus "blight" designation on several local businesses and received national media coverage.
I was brought on to maintain and expand the group's website. I migrated the existing content to the Drupal Content Management System and made use of Drupal's many built in modules to add support for blogs and forums to the website. This caused the website to grow exponentially from a dozen pages at the time to 4,000 pages and blog entries today. This has had the result of giving our members a way to stay active through blogging and participating in the site's forums.
2005 : 2014
Save Ardmore Coalition
Webmaster, Board Member
- Researched the AWS Elastic Map Reduce product and used it to build a Hive cluster
running on top of Hadoop. Created a messagebased system so multiple machines
could concurrently import data into Hive for business analysis purposes.
- Evaluated Vagrant and began using it for development purposes and for testing out Chef
recipes. Created Chef recipes that could be used to build development machines.
- Contributed to LeadEngine, our node.jsbased system for auctioning hundreds of leads in
real time to multiple buyers.
2012 : 2013
Leadnomics
Principal Software Engineer
2019 : Present
Comcast
Senior Cybersecurity Engineer
- Architected and implemented the 7th largest DMARC report generator in the world, generating DMARC reports for over 30,000 domains each day.
- Continued to grow our Splunk cluster for data processing of logs from Cocmast.net mail servers and other sources. Expanded capacity to 7 TB/day of data and ~300,000 events per second. Also increased retention of all logs into the 100s of TB range.
- Created the Spam Repository Database microservice to handle spam complaints from users. Written in Node.js, this microservice handles 100s of reports a second during peak times.
- Architected use of 100+ Heavy Forwarders to receive traffic and filter out what was unnecessary, saving the organization many thousands of dollars a year in Splunk licensing fees. All sources of data had Heavy Forwarders in at least 3 different datacenters to ensure availability in case of an outage. All communication from Heavy Forwarders to Indexers is secured with SSL.
- Moved entire Splunk infrastructure (several Search Heads, dozens of Indexers, and dozens more Heavy Forwarders) into Puppet to centralize management of those machines. With Puppet, I proceeded to enable performance monitoring on all machines and create iptables rules to enforce organizational policy (such as limiting what Deployment Servers HFWs could talk to).
- Architected an upgrade of our entire Splunk cluster containing multiple search Heads and dozens of Indexers from 5.0.6 to 6.3. In the process, created a Clustered Search Head group to ensure availability in case one machine goes down.
Prior assignments at Comcast include serving on the Residential Anti-Abuse Team for the @Comcast.net SMTP servers, and being the Lead Engineer on the Signature Support Team.
2013 : 2019
Comcast Cable
Senior Engineer and Splunk Architect
Anthrocon, Inc. is a 501(c)7 non-profit registered in the Commonwealth of Pennsylvania. Our annual convention has grown from 1,900 attendees in 2003 to 9,300 in 2019. We have had a cumulative economic impact of over $50 million in Pittsburgh since moving the convention there in 2006.
From 2015 to 2017, I was the organization's Technology Director, largely responsible for our online presence, including a website, and a social media channel on virtually every social network, including Twitter, where we have over 45,000 followers.
Starting in 2008, I created the convention's social media assets. I grew our follower base from zero to our current numbers : 45,000 followers on Twitter, and a combined 90,000 followers across all social media platforms and groups.
From 2003 to 2015 I was the Operations Director, responsible for the Operations Department, with a staff of 6 to 8 individuals reporting to me. This department is responsible for logistics and support of other departments and volunteers before, during, and after our annual conference in Pittsburgh, PA.
2003 : 2018
Anthrocon, Inc
Board Of Directors
The Save Ardmore Coalition is a 501(c)4 civic group based out of Ardmore, PA. It was originally founded to fight a bogus "blight" designation on several local businesses and received national media coverage.
I was brought on to maintain and expand the group's website. I migrated the existing content to the Drupal Content Management System and made use of Drupal's many built in modules to add support for blogs and forums to the website. This caused the website to grow exponentially from a dozen pages at the time to 4,000 pages and blog entries today. This has had the result of giving our members a way to stay active through blogging and participating in the site's forums.
2005 : 2014
Save Ardmore Coalition
Webmaster, Board Member
- Researched the AWS Elastic Map Reduce product and used it to build a Hive cluster
running on top of Hadoop. Created a messagebased system so multiple machines
could concurrently import data into Hive for business analysis purposes.
- Evaluated Vagrant and began using it for development purposes and for testing out Chef
recipes. Created Chef recipes that could be used to build development machines.
- Contributed to LeadEngine, our node.jsbased system for auctioning hundreds of leads in
real time to multiple buyers.
2012 : 2013
Leadnomics
Principal Software Engineer
Company:
Comcast
About
I like to automate things, write code to automate things, and do data analytics with Splunk. Docker and Python are also amazing! Currently teaching myself Grafana, Loki, and Prometheus.
Profile Photo
