Processing 200,000 Records in Under 3 Hours
“Pay Per Use” is a common billing strategy where customers are charged depending on how many times they use a certain feature. Recently, our current monthly batch process that loads usages records into Salesforce was failing due to the ESB system being overwhelmed. The system was originally designed to handle 20,000 records a month but we had just crossed the 200,000 record count last month, a 10x increase of what was expected. While a great problem to have for the business, as a developer and architect I had to find a way to keep a handle on this load and keep the process running.
Our current ESB system (name omitted) which runs in a 4 server cluster simply couldn’t handle the size of the input. During the first hour it would process a consistent 22 transactions a second; however the longer it ran the slower it got. Often we would find it crawling along as low as 2 transactions a second. At this point, we would need to quickly restart the whole ESB before timeouts starting occurring and records were lost. https://goo.gl/zVhTgd #DataIntegration #ML
Programmable Infrastructure in Your Organization
ICYMI: Background
At Atlassian, we believe in releasing quality products frequently and predictably to our customers. A continuous delivery pipeline is a classic example of programmable infrastructure that helps execute on that vision. Read about continuous delivery and its business value for more context.
We, Atlassian, are the makers of Bitbucket and I love how source code, commits, branches, pull requests, pipelines, and deployments are organized in our “one-stop shop” Bitbucket UI. See the left panel in the screenshot below. https://goo.gl/L3NMVA #DataIntegration #ML
Huawei Collaborates with Vodafone and Bosch to Enable Smart Cars to Communicate with Each Other
ICYMI: #Technology For the first time in Europe, Huawei, Vodafone Germany, and Bosch have successfully tested the extended usage of Cellular vehicle to everything (C-V2X R14) in combination with Bosch’s Adaptive Cruise Control (ACC) driver assistance system. The three companies have been performing trials of the new, high-performance technology for the past year on the A9 freeway in Bavaria, Germany, using a pre-standard 5G network. http://bit.ly/2u1tYMl #Huawei #BigData #AI