Category: Tech

AWS – Automating EBS Snapshots (Create & Delete after X Days) using Bash and Cron

This guide will show you how you can automate the AWS EBS volume snapshots on specified EC2 Instances whilst also checking and deleting any volume snapshots older than X days using a simple Bash script with AWS CLI. Pre-Requisites You will need some pre-requisites before starting: AWS CLI An EC2 Instance with EBS Storage Python ...

PrestoDB – Basic Installation with HTTPS/SSL Configuration

PrestoDB is an open source tool that was developed by Facebook and provides a way of connecting multiple workers to use their resources for querying various services (e.g. Hive, Kafka, etc…) while distributing/parallizing the load. More info can be found at PrestoDB. This guide will show you how you can start with a small PrestoDB environment ...

Graylog – Basic Installation with HTTPS/SSL Configuration

Graylog is an open source tool that provides central log management, simple visualizations, alerting and dashboards. It can also use Kafka as an Input node (basically using Kafka as an alternative to Logstash or syslog if need be) It can be seen as an open source alternative to Splunk, where it makes use of a ...

Ambari/HDP – Install & Configure an HDP BigData environment

Ambari is an open source tool that provides central web management, configuration and installation of various BigData services. HDP is an abbreviation for Hortonworks Data Platform. Hortonworks provides a complete distribution framework (HDP Repository) where all the main BigData tools/services can be found and installed via Ambari itself in an easier way. Hortonworks Site This guide ...

Apache NiFi – Cluster configuration

Apache NiFi is an open source project mainly designed to support automation of data flows between systems. This blog is part of a complete guide divided in 3 separate posts: Part 1: Apache NiFi – Basic installation with HTTPS/SSL & LDAP Configuration Part 2: Apache NiFi – Configure Data Flow & NiFi Policies Part 3: Apache ...

Apache NiFi – Configure DataFlow & NiFi Policies

Apache NiFi is an open source project mainly designed to support automation of data flows between systems. This blog is part of a complete guide divided in 3 separate posts: Part 1: Apache NiFi – Basic installation with HTTPS/SSL & LDAP Configuration Part 2: Apache NiFi – Configure Data Flow & NiFi Policies Part 3: Apache ...

Apache NiFi – Basic installation with HTTPS/SSL & LDAP Configuration

Apache NiFi is an open source project mainly designed to support automation of data flows between systems. This blog is part of a complete guide divided in 3 separate posts: Part 1: Apache NiFi – Basic installation with HTTPS/SSL & LDAP Configuration Part 2: Apache NiFi – Configure Data Flow & NiFi Policies Part 3: Apache ...

Advertisements
Advertisements