This is fork uses Docker containers instead of VirtualBox. I needed Calavera to be run on virtualized hosts, and is much easier to do that with Docker. Not all virtualization technologies allow to run nested Virtual Machines, also is much more lightweight for this uses. (Also adds some isolation quirks, which required some work)
I've also added a "dnsmasq" only container, which really eases the inter-container and host-container communications. (Something on which docker also have some problems)
- Install Latest vagrant version from [here] (http://www.vagrantup.com/downloads.html). (Download the package and install it with "sudo dpkg -i")
- Install latest docker.
wget -qO- https://get.docker.com/ | sudo sh
- Install build-essential (Some steps may require compile things)
sudo apt-get install build-essential
- Install chef-dk from [here] (https://downloads.chef.io/chef-dk/). This includes berkshelf, needed for the provision. Install it with:
sudo dpkg -i chefdk_0.6.2-1_amd64.deb
- Install the vagrant-berkshelf plugin
vagrant plugin install vagrant-berkshelf
- Clone this repo on some dir. And, as "root" user go inside the Calavera repo. (All environment handling must be done as root)
git clone <clone_url_for_this_repo>
- Copy your SSH keys to the shared/keys directory (if you don't have those keys, run
ssh-keygen -t rsaand then copy the contents of $HOME/.ssh to the shared/keys directory
- First time build the Calavera machines with:
./calavera.build.sh- Every time you run this script, all the nodes will be destroyed and purged. So just use it when you want to initialize or to completelly clean the environment.
- You can handle the nodes "brazos","espina",etc... with normal vagrant commands.
- Everytime you want to re/start the environment, use:
./calavera.startup.sh- This will make the environment up and running in case it was in an unstabe state.
- Be careful with your DNS settings. As stated here ( http://stackoverflow.com/questions/23012273/setting-up-docker-dnsmasq) When using the dnsmasq container, it's important to keep in mind that it will use the information in the
/etc/resolv.confof the host system and that content is usually a dynamic configuration. You will need that the DNS server points to the local IP@ where the docker dnsmasq server is bound (usually eth0). So you shoud:- Set up the
/etc/resolv.conffile adding a line that saysnameserver 172.16.251.151 sudo docker stop dnsmasqsudo docker start dnsmasq
- Set up the
This is a project to create a simplified, reproduceable DevOps pipeline for educational purposes. It uses "infrastructure as code" principles to configure git, Vagrant, Java, JUnit, Ant, Jenkins, Chef Zero, and Artifactory into an integrated, end to end system.
There are a number of benefits you might find in this project. While the basic DevOps principles it illustrates are simple and widely understood, it can nevertheless be frustrating to properly configure all the interactions in an end to end DevOps pipeline. There are any number of issues lurking in integrating the pipeline: .ssh setup, permissions, build choreography interactions (e.g. git/Jenkins/Artifactory), software versions, and the like.
This gives you a functioning starting point, a "known good" baseline running as a cluster of 6 Ubuntu VMs under Vagrant and Chef, that does the following:
- Gives you a basic test-driven "Hello World" Java example with JUnit, Ant, Tomcat, and git.
- When you execute a build on that environment, if successful it pushes to a remote master git repository.
- That commit then triggers Jenkins to execute a build on a "slave" node.
- If that build succeeds, the result is archived to Artifactory.
- You then can (with Chef) deploy the result to a simulated "production" node.
All the configurations are expressed in the Vagrantfile and the Chef cookbooks, so you can inspect and adapt them. No magic here. See the instructions.
Some may be particularly interested in the Calavera example of how Chef can provision Jenkins through the Jenkins api. This includes provisioning and controlling a slave, integrating with git through a githook, and integrating with Artifactory. It's all there; have a go with it. The Vagrant machine that runs Jenkins is called "hombros." See the hombros cookbook and the brazos cookbook.
See https://github.com/CharlesTBetz/Calavera/wiki/Calavera-Home and other wiki pages for full, evolving description.
See http://www.lean4it.com/2014/10/devops-simulation-for-education.html for initial motivation.
Open for business. Please let me know what you think. And please help.
2015-03-02 note OK I changed my mind about releasing. After I finished the installation instructions yesterday and confirmed a couple succesful builds on different machines, I decided to go ahead and call 0.3 the first official alpha release.
The last 3 weeks have marked Calavera's debut in a classroom setting. It has been a lot of work and very exciting for both me and (I think) the students. This week, they are standing up their own instances of the Manos development environment.
Been doing some final polishing. The public Calavera alpha release is delayed due to my educational commitments - have to prioritize creating the labs. Testing the system under fire in the classroom also seems appropriate before publishing.
But a motivated person can certainly download and stand up the virtual machines at this point. I am currently working on the installation instructions.
See previous updates on the Calavera blog
The next major steps will be:
- Create a MEAN-stack based development pipeline
- Support Docker in addition to VirtualBox (may deprecate VirtualBox, depending)
- Integrate with Cloud providers
I'm an architect, advisor, and instructor. My career focus has been the "business of IT" including concerns such as enterprise architecture, IT service management, IT portfolio management, and IT financial management. However, I also believe that hands on engagement is essential.
I am not a professional software developer, infrastructure engineer, or systems administrator, although I know many. I have the deepest admiration for the professionals I see here on Github developing Vagrant plugins, Chef cookbooks, and the like. I know my work is not up to that standard. There are any number of aspects in these scripts that professionals might criticize. In part, this project has helped me learn the technologies at hand, so it is by definition amateurish.
However, as near as I can tell the concept is original, and I intend to build on it far beyond a DevOps pipeline. As part of the InsanIT initiative, it realizes the architecture principles I am using in my 3rd edition of The Architecture of IT Management. It is also a reference implementation of IT4IT. More to come on this.
I welcome collaborators and am ready to entertain pull requests if anyone wants to help. This work is a life priority for me.
One audience that I hope will find benefit in this is people like me - mid-career types who are watching all the buzz about DevOps in the media and looking for some accessible way to get a little deeper into it. Folks, when I started this I did not know ANY of the technologies here except a little bit of Java.
You can of course take 2 week courses in each of these technologies, but this is an alternate approach: see just enough of each in action to understand how it contributes to the overall system. It's been well worth it for me.
See the wiki for further information. And of course www.lean4it.com.