K8s

python 3.x – PySpark on Jupyterhub K8s || Unable to query data || Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

by

Pyspark Version: 2.4.5 Hive Version: 1.2 Hadoop Version: 2.7 AWS-SDK Jar: 1.7.4 Hadoop-AWS: 2.7.3 When I am trying to show data I am getting Class org.apache.hadoop.fs.s3a.S3AFileSystem not found while I am passing all the information which all are required. I passed all three for this config fs.s3.aws.credentials.provider org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider com.amazonaws.auth.InstanceProfileCredentialsProvider com.amazonaws.auth.EnvironmentVariableCredentialsProvider But nothing worked Sample Code: … Read more

Build a Quarkus Reactive Application: K8s Secrets

by

Many organizations have security policies in place that dictate how to store sensitive information. When you’re developing applications for the cloud, you’re probably expected to follow those policies, and to do that, you often have to externalize your data storage. Kubernetes has a built-in system to access external secrets, and learning to use that is … Read more

linux – one of node in my k8s cluster,cannot resolve domain name

by

one node cannot resolve domain name I have a k8s cluster.It has one master and three nodes. K8smaster, k8snode1, k8snode2, k8snode3 I run this yaml for test. apiVersion: v1 kind: Pod metadata: apiVersion: v1 kind: Pod metadata: name: busybox-0 namespace: default spec: containers: – image: busybox:1.28 command: – sleep – “3600” imagePullPolicy: IfNotPresent name: busybox-0 … Read more

Implementing RBAC Configuration for K8s Apps

by

Security is challenging to implement, and when your infrastructure is made up of many dynamic, scalable, distributed microservices running in containers, the task becomes even more complex. Kubernetes is an open-source container orchestration technology that may be used to automate software applications’ deployment, scaling, and administration. We commonly refer to these levels as the 4Cs … Read more

How to Make K8s Adoption Easier for Developers

by

Kubernetes offers developers tremendous advantages… if they can overcome the platform’s inherent complexities. It can be a big “if.” Without additional tooling, developers aren’t able to simply develop their applications on Kubernetes, but must also become experts in writing complex YAML templates to define Kubernetes resources. A relatively new tool called Shipa provides an application … Read more