Google Summer of Code 2017 - Standardizing Kubernetes Logs (CNCF)

Code before pondering. Multipurpose learning

🚀 Project tracker - Create and implement a data model to standardize Kubernetes logs (CNCF)

🙇Student Portfolio

• Name : Amit Kumar Jaiswal
• E-mail : [email protected]
• Github : amitkumarj441
• Twitter: AMIT_GKP
• Web : https://amitkumarj441.github.io/

🎉Links

• GSoC 2017 Proposal
• CNCF Blog
• GSoC with CNCF
• Waffle Board

Tasks :

• 1st Evaluation Tasks [30th May - 30th June 2017]

  • Deploying OpenShift + Logging + ViaQ bits [ Skip MUX configuration]
  • Setting up common data model used by Elasticsearch and Kibana
  • Configuration of Fluentd with Testing

• Mid Evaluation Tasks [30th June - 28th July 2017]

  • Creating Pods and its configuration
  • Setting up the pipeline into Elasticsearch
  • Configuring and streaming logs from Fluentd into Elasticsearch
  • Launch Elasticsearch as a replication controller

• Final Evaluation Tasks [28th July - 21st August 2017]

  • Change easily fluentd pod configuration
  • Structuring Kubernetes logs
  • Create filter to rewrite "origin-node" and "origin-master" logs
  • Create filter with Kubernetes logs structure
  • Display Kubernetes components logs in Kibana

Demo!

Blog posts

• GSoC with Kubernetes@CNCF
• GSoC 2017@CNCF

Pull Requests and Issues

Repository: ViaQ

Total Pull Requests Created/Merged: 4

1. ViaQ/Main#5 - Added Patch OpenShift Ansible
2. ViaQ/Main#10 - Updated Fluentd Pod Config
3. ViaQ/Main#21 - Update link [README-mux.md -> README-install.md]
4. ViaQ/Relp#15 - Typo Fixed

Repository: OpenShift Origin

Total Pull Requests Created: 1

1. openshift/origin-aggregated-logging#517 - Update to Fluentd and logging components

Total Issues Opened: 1

1. openshift/origin-aggregated-logging#549 - Prometheus exporter to expose metrics from Elasticsearch

Repository: Kubernetes Incubator/Kubespray

Total Pull Requests Created/Merged: 1

1. kubernetes-incubator/kubespray#1408 - Remove deprecated enable-cri flag in Kubernetes 1.7

Repository: Kubernetes

Total Issues Opened: 1

1. kubernetes/kubernetes#51405 - Fluentd filter to process Kubernetes logs