By running a custom-built Elasticsearch on AWS, you have to do everything on the console. AWS has its Elasticsearch offering but I had this project handed over to me and it's running an old instance of Elasticsearch before AWS had its own. Data pollution is a common...
Reading an article on Read an article on Oreilly.com about Software Engineers and it really resonates with me - feel free to read the article yourself. As a Software Engineer, I have discovered the miracle of self development. No company or manager...
BigData and Agile seem not to be friendly in the past but that is no more the case. One of the important points in processes data is data integrity. Assuming you are pulling data from an API(Application Programming Interface) and performing some processing on the...