Skip to content

Making FB's flashcache to cache a group of disks with a single SSD

Notifications You must be signed in to change notification settings

lihuiba/flashcachegroup

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

flashcachegroup (fcg)

fcg makes fb's flashcache to cache a group of disks with one or multiple SSDs.

Group of hard disk(s) can be dynamically created , and caching can be applied on the group instead of each individual disk.

Hard disk(s) can be dynamically added to or removed from the group on demand.

In case of failure(s), SSD(s) can be replaced transparently, without interrupting upper layers.

Principle

Figure 1(a) shows the structure of a cached group of HDs, and figure 1(b) adds some explanation, which can be described as follow:

1. Fcg respectively combines the group of HDs and all the SSDs, with dm-linear.

2. Fcg invokes flashcaceh-create to cache the group of HDS with SSDs.

3. Fcg splites the hard disks out from the cached group, with dm-linear too.

alt tag

figure 1(a)

alt tag

figure 1(b)

Usage(fcg)

fcg create [-h] [-g GROUP] [-c CACHEDEV [CACHEDEV ...]] [-b BLOCKSIZE] [-p PATTERN]

fcg delete [-h] [-g GROUP]

fcg add [-h] [-g GROUP] [-d DISK]

fcg remove [-h] [-g GROUP] [-d DISK]

Usage(fcg-easy)

to create a new group by using hard disks:

fcg-easy create [-h] [-g GROUP] [-d DISK [DISK ...]]
                [-c CACHEDEV [CACHEDEV ...]] [-b BLOCKSIZE] [-s SIZE]
                [-p PATTERN] [-y] [--skip SKIP] [--discard] [--trim]

to delete an UNUSED group:

fcg-easy delete [-h] [-g GROUP] [-y]

to replace broken SSDs:

fcg-easy rep-ssd [-h] [-g GROUP] [-c CACHEDEV [CACHEDEV ...]]

Requirements

Python

Python 2.6 and 2.7 (does NOT support Python 3.x)

Modules

  • flashcache
  • pydm

Installation

The easiest way to install is with pip::

sudo pip install flashcachegroup

Or manually (assuming all required modules are installed on your system)::

sudo python ./setup.py install

Change log

v0.6.6:

  1. roll back if failed when create fcg.
  2. simplify code.

v0.3.0:

rewrite fcg and separate dmsetup to pydm

v0.2.10:

add -s -b -p --skip --discard --trim arguments when create fcg

About

Making FB's flashcache to cache a group of disks with a single SSD

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages