picture_credits

Hello Everyone!
This chapter is about upgrading the Kubernetes cluster with kubeadm.
So let's get started.

Steps to upgrade the control plane:

1. Upgrade kubeadm:

[user@k8s-control]$ sudo apt-get update && \ sudo apt-get install -y --allow-change-held-packages kubeadm=1.21.1-00

Check for the upgraded version:

[user@k8s-control]$ kubeadm version

2. Drain the control plane node:

[user@k8s-control]$ kubectl drain k8s-control --ignore-daemonsets

3. Run the plan for upgrade:

[user@k8s-control]$ sudo kubeadm upgrade plan v1.21.1

4. Upgrade the control plane components:

[user@k8s-control]$ sudo kubeadm upgrade apply v1.21.1

5. Upgrade kubelet and kubectl on the control plane node:

[user@k8s-control]$ sudo apt-get update && \ sudo apt-get install -y --allow-change-held-packages kubelet=1.21.1-00 kubectl=1.21.1-00

6. Restart kubelet:


picture credits

In search of my paradise, Where I am a queen,
Where I can fly and I can breathe,
Where I can find peace even in loud music,
Where I can fly non-stop, high, and super high!

Where I can express loud, shout loud,
Sing loud, laugh loud, love loud!

Where sunset is not the beginning of darkness,
But it begins a new light!
Where stars shine bright even on cloudy nights.

Where I can rule on my heart, my thoughts,
my heart, myself!
Where I can again fall in love and win over my heart!

Where I can again live my childhood,
Those stupid yet cute pranks!
Where I can again be myself, my own self!

Where I am not bounded to anything,
And there is no boundation,
Just in the open sky, flying above the ocean,
In search of my PARADISE


Hello Everyone!
When your presto cluster deals with heavy data processing queries and presto workers are running on spot instances using spot.io, the graceful shutdown will surely gonna help you out to avoid query failures due to abrupt spot termination.

Abrupt spot termination can unstable the presto cluster with errors like -” Internal Server Error ” or “Service Unavailable”. We can avoid this with two simple steps:

Step 1 . Install Spotinst agent which can monitor for spot termination every 10 seconds:

#!/usr/bin/env bash
curl -fsSL https://s3.amazonaws.com/spotinst-public/services/spotinst-agent-2/elastigroup-agent-init.sh | \
SPOTINST_ACCOUNT_ID=”<spotinst account id>” \
SPOTINST_TOKEN=”spotinst auth token" \
bash

Navigate to…


To make your prestodb access secure , its always a good idea to enable password based login. Here we will be discussing two password based login methods :
File based authentication and LDAP authentication.
So lets get started.

For both the methods , append below in your config.properties file

http-server.process-forwarded=true
http-server.authentication.type=PASSWORD

1.Password Based Login using a file:

Create a file in the same directory where your config.properties file is located.
These changes are to be done in coordinator node.
Below is the default home_path comes with starburst presto ami

$ touch /var/lib/presto/etc/password-authenticator.properties

now paste the below content and save the…


Its been more than an year now , we all are in this pandemic together. We have seen many ups and downs, going through tough times , may be emotionally , psychologically , morally , physically and what not .
Some of us are still trying to predict upcoming events ,and may be some of us have already accepted this. When I look at 2020 , I realize that I would have never known about my strengths and weaknesses.
I do miss my routine , rigorous work ,those tea breaks and gossips . Probably this monotony needed a break.
Lets take a…


This lab is focused on deploying Prestodb cluster using aws marketplace starburst image . For first 15 days you can subscribe to the free trial where you just have to pay for the server you want to use.

Subscribe for starburst presto , and we are good to go for deploying our first presto cluster on aws.

Pr-requisite:
create an IAM role for creating presto cluster and attach below as a policy

https://github.com/kshivani123/presto_template/blob/main/policy_for_presto_role

Steps to follow:

  1. Go To aws console and click on Cloudformation service , then click on create stack:

2. Now download the below file :
https://github.com/kshivani123/presto_template/blob/main/persto_cloudformation_template

Now…


This lab is all about executing queries in prestodb with amazon s3 in the back end .We will be executing DDL(data definition language) and DML(data manipulation Language) statements . For configuring Presto Cluster , follow Chapter 2

Query Execution Flow

Scenario 1:
In this , we will be creating a table which will act as a logical separation for the data , and then we will insert some records , define the format in which we want to insert the data , and finally will query the data.

Create a table :

presto-cli --server localhost:8080 --catalog hive
presto> use default
-> ;
USE


Yes I am strong , but at times I am fragile too,
Yes I am bold , but at times I am shy too,
I live many roles
I am a daughter , I am a sister, I am a lover , I am a mother
But with all this , I live my individuality too,
Yes I have a pure heart, but I have sinful desires too
Yes I can give my all to you, but at times I am selfish too,
Don’t assume that I am made of all gold
Don’t put me on upper pedestal or treat me like a goddess
Don’t take me…


In this lab , we will be setting up presto cluster with one coordinator node and one worker node. You can follow same settings to sync up “n” number of worker nodes along with the coordinator.
Note: For understanding presto architecture and how a cluster works in presto , you can visit chapter 1

Steps to perform on the coordinator node :

  1. Pr-requisites:
    Download Presto tar ball from the below link :
https://repo1.maven.org/maven2/com/facebook/presto/presto-server/0.250/presto-server-0.250.tar.gz

a. The above tar will contain a single directory, presto-server-0.250, which will be called in the installation directory ,

b. Java version: OpenJDK 64-Bit Server VM (build 11.0.9.1+1-Ubuntu-0ubuntu1.18.04) ,
and Ubuntu 18.04.5 LTS

2. Create…


What is Prestodb?

Prestodb(Presto) is an opensource SQL query engine which is used for speeding up the execution of analytics queries against data of any size.
It can be used with relational databases like MySQL, PostgreSQL, Amazon Redshift, Microsoft SQL Server, and Teradata ; and non-relational databases like Hadoop Distributed File System (HDFS), Amazon S3, Cassandra, MongoDB, and HBase.
Presto queries data where it is stored , and there is no need for moving data to any analytics system separately. Query execution takes place in parallel over a memory based architecture which allows to return response in seconds.

How Prestodb…

DevOps Engineer, Passionate for new tools and Technology!

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store