2 comments on “AWS – Automating EBS Snapshots (Create & Delete after X Days) using Bash and Cron”

AWS – Automating EBS Snapshots (Create & Delete after X Days) using Bash and Cron

This guide will show you how you can automate the AWS EBS volume snapshots on specified EC2 Instances whilst also checking and deleting any volume snapshots older than X days using a simple Bash script with AWS CLI. Pre-Requisites You…

4 comments on “Kafka – Using Authorization/ACL (without Kerberos) with SSL Configuration in a Docker container”

Kafka – Using Authorization/ACL (without Kerberos) with SSL Configuration in a Docker container

Kafka is an open source tool that is a distributed streaming platform mainly used for consuming and producing records in real-time (similar to a messaging system) while being fault tolerant when configured in a cluster. More info can be found…

2 comments on “PrestoDB – Basic Installation with HTTPS/SSL Configuration”

PrestoDB – Basic Installation with HTTPS/SSL Configuration

PrestoDB is an open source tool that was developed by Facebook and provides a way of connecting multiple workers to use their resources for querying various services (e.g. Hive, Kafka, etc...) while distributing/parallizing the load. More info can be found…

0 comments on “Graylog – Basic Installation with HTTPS/SSL Configuration”

Graylog – Basic Installation with HTTPS/SSL Configuration

Graylog is an open source tool that provides central log management, simple visualizations, alerting and dashboards. It can also use Kafka as an Input node (basically using Kafka as an alternative to Logstash or syslog if need be) It can…

0 comments on “Ambari/HDP – Install & Configure an HDP BigData environment”

Ambari/HDP – Install & Configure an HDP BigData environment

Ambari is an open source tool that provides central web management, configuration and installation of various BigData services. HDP is an abbreviation for Hortonworks Data Platform. Hortonworks provides a complete distribution framework (HDP Repository) where all the main BigData tools/services…

0 comments on “Apache NiFi – Configure DataFlow & NiFi Policies”

Apache NiFi – Configure DataFlow & NiFi Policies

Apache NiFi is an open source project mainly designed to support automation of data flows between systems. This blog is part of a complete guide divided in 3 separate posts: Part 1: Apache NiFi - Basic installation with HTTPS/SSL & LDAP…