Tech Posts
Python: Cleanup all Conda environments
Conda is a popular open-source package manager and environment management system used for Python...
Docker: Stop all containers now!
Docker has changed our world. A very useful component in the toolbox of any Software Engineer or...
Bash: Delete History in Terminal
Sometimes while working on the terminal or commandline as you know it, the history becomes clogged...
Python: Cleanup all Conda environments
Conda is a popular open-source package manager and environment management system used for Python programming language. It is widely used by data scientists and machine learning engineers for...
Docker: Stop all containers now!
Docker has changed our world. A very useful component in the toolbox of any Software Engineer or perhaps, any forward-thinking company. What is Docker? Why Docker? and other questions relating to...
Bash: Delete History in Terminal
Sometimes while working on the terminal or commandline as you know it, the history becomes clogged with simple common commands like ls -al and you want to remove X number of lines to keep your...
Jest: Ignore CSS files while running tests
To ensure Jest ignores CSS files when running tests, simply follow the steps below: Install a module: `identity-obj-proxy` npm install -D identity-obj-proxy 2. Update your jest...
Compare Millions of messages using Spark(PySpark)
Using the Power of Apache Spark(PySpark) to Verify Loads of Messages Imagine a scenario where you have a system costing you about £30K to run and maintain coupled with the fact that it is a...
Elasticsearch: Bulk ingest data
Often you think of a solution to a simple problem and once you come up with that solution you realise you need to apply this to a large dataset. In this post, I will explain how I deployed a...
Elasticsearch Cleansing
By running a custom-built Elasticsearch on AWS, you have to do everything on the console. AWS has its Elasticsearch offering but I had this project handed over to me and it's running an old...
What to Improve in 2016
Reading an article on Read an article on Oreilly.com about Software Engineers and it really resonates with me - feel free to read the article yourself. As a Software Engineer, I have...
BigData at the Commandline
BigData and Agile seem not to be friendly in the past but that is no more the case. One of the important points in processes data is data integrity. Assuming you are pulling data from an...