Ironfan: A Community Discussion Webinar

Thursday, January 31 @ 10a P, 12p C, 1p E

Join Nathaniel Eliot, @temujin9, DevOps Engineer and lead on Ironfan, in this community discussion. Ironfan is a lightweight cluster orchestration toolset, built on top of Chef, which empowers spinning up of Hadoop clusters in under 20 minutes. Nathan has been responsible for Ironfan’s core plugin code, cookbooks, and other components to stabilize both Infochimps’ open source offerings, and internal architectures. Register Now

Ironfan Core: Knife Tools and Core Models

Ironfan, the foundation of The Infochimps Platform, is an expressive toolset for constructing scalable, resilient architectures. It works in the cloud, in the data center, and on your laptop, and it makes your system diagram visible and inevitable. Inevitable systems coordinate automatically to interconnect, removing the hassle of manual configuration of connection points (and the associated danger of human error). For more information about Ironfan and the Infochimps Platform, visit infochimps.com.

This repo implements:

• Core models to describe your system diagram with a clean, expressive domain-specific language
• Knife plugins to orchestrate clusters of machines using simple commands like knife cluster launch
• Logic to coordinate truth among chef server and cloud providers

Getting Started

To jump right into using Ironfan, follow our Installation Instructions. For an explanatory tour, check out our Web Walkthrough. Please file all issues on Ironfan issues.

Tools

Ironfan consists of the following Toolset:

• ironfan-homebase: centralizes the cookbooks, roles and clusters. A solid foundation for any chef user.
• ironfan gem:
  • core models to describe your system diagram with a clean, expressive domain-specific language
  • knife plugins to orchestrate clusters of machines using simple commands like knife cluster launch
  • logic to coordinate truth among chef server and cloud providers.
• ironfan-pantry: Our collection of industrial-strength, cloud-ready recipes for Hadoop, HBase, Cassandra, Elasticsearch, Zabbix and more.
• silverware cookbook: coordinate discovery of services ("list all the machines for awesome_webapp, that I might load balance them") and aspects ("list all components that write logs, that I might logrotate them, or that I might monitor the free space on their volumes".

Documentation

• Index of wiki pages
• Ironfan wiki: high-level documentation
• Ironfan issues: bugs, questions and feature requests for any part of the ironfan toolset.
• Ironfan gem docs: rdoc docs for Ironfan
• Ironfan Screencast -- build a Hadoop cluster from scratch in 20 minutes.
• Ironfan powers the Infochimps Platform, our scalable enterprise big data platform. Ironfan Enterprise adds zero-configuration logging, monitoring and a compelling UI.

Note: Ironfan is not compatible with Ruby 1.8. All versions later than 1.9.2-p136 should work fine.

The Ironfan Way

• Core Concepts -- Components, Announcements, Amenities and more.
• Philosophy -- Best practices and lessons learned
• Style Guide -- Common attribute names, how and when to include other cookbooks, and more
• Homebase Layout -- How this homebase is organized, and why

Getting Help

• Feel free to contact us at [email protected] or 855-DATA-FUN
• Also, you're invited to a private consultation with Infochimps founders on your big data project.