org.apache.hadoop.hbase.regionserver

Class AbstractMemStore

java.lang.Object

org.apache.hadoop.hbase.regionserver.AbstractMemStore

All Implemented Interfaces:

MemStore

Direct Known Subclasses:

CompactingMemStore, DefaultMemStore

@InterfaceAudience.Private
public abstract class AbstractMemStore
extends Object
implements MemStore

An abstract class, which implements the behaviour shared by all concrete memstore instances.

Field Summary

Fields

Modifier and Type	Field and Description
protected MutableSegment	active
static long	DEEP_OVERHEAD
static long	FIXED_OVERHEAD
protected RegionServicesForStores	regionServices
protected ImmutableSegment	snapshot
protected long	snapshotId

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractMemStore(org.apache.hadoop.conf.Configuration conf, CellComparator c, RegionServicesForStores regionServices)

Method Summary

Modifier and Type	Method and Description
void	add(Cell cell, MemStoreSizing memstoreSizing) Write an update
void	add(Iterable<Cell> cells, MemStoreSizing memstoreSizing) Write the updates
static void	addToScanners(List<? extends Segment> segments, long readPt, List<KeyValueScanner> scanners)
protected static void	addToScanners(Segment segment, long readPt, List<KeyValueScanner> scanners)
protected abstract void	checkActiveSize() Check whether anything need to be done based on the current active set size
void	clearSnapshot(long id) The passed snapshot was successfully persisted; it can be let go.
protected void	dump(org.slf4j.Logger log)
protected CellComparator	getComparator()
protected org.apache.hadoop.conf.Configuration	getConfiguration()
protected Cell	getLowest(Cell a, Cell b)
protected Cell	getNextRow(Cell key, NavigableSet<Cell> set)
protected abstract List<Segment>	getSegments()
MemStoreSize	getSnapshotSize() Return the size of the snapshot(s) if any
protected abstract long	heapSize()
protected abstract long	keySize()
protected void	resetActive()
long	timeOfOldestEdit()
String	toString()
abstract void	updateLowestUnflushedSequenceIdInWAL(boolean onlyIfMoreRecent) Updates the wal with the lowest sequence id (oldest entry) that is still in memory
void	upsert(Iterable<Cell> cells, long readpoint, MemStoreSizing memstoreSizing) Update or insert the specified cells.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.regionserver.MemStore

getFlushableSize, getScanners, isSloppy, preFlushSeqIDEstimation, size, snapshot, startReplayingFromWAL, stopReplayingFromWAL

Field Detail

active

protected volatile MutableSegment active

snapshot

protected volatile ImmutableSegment snapshot

snapshotId

protected volatile long snapshotId

regionServices

protected RegionServicesForStores regionServices

FIXED_OVERHEAD

public static final long FIXED_OVERHEAD

DEEP_OVERHEAD

public static final long DEEP_OVERHEAD

Constructor Detail

AbstractMemStore

protected AbstractMemStore(org.apache.hadoop.conf.Configuration conf,
                           CellComparator c,
                           RegionServicesForStores regionServices)

Method Detail

addToScanners

public static void addToScanners(List<? extends Segment> segments,
                                 long readPt,
                                 List<KeyValueScanner> scanners)

addToScanners

protected static void addToScanners(Segment segment,
                                    long readPt,
                                    List<KeyValueScanner> scanners)

resetActive

protected void resetActive()

updateLowestUnflushedSequenceIdInWAL

public abstract void updateLowestUnflushedSequenceIdInWAL(boolean onlyIfMoreRecent)

Updates the wal with the lowest sequence id (oldest entry) that is still in memory

Parameters:

onlyIfMoreRecent - a flag that marks whether to update the sequence id no matter what or only if it is greater than the previous sequence id

add

public void add(Iterable<Cell> cells,
                MemStoreSizing memstoreSizing)

Description copied from interface: MemStore

Write the updates

Specified by:

add in interface MemStore

memstoreSizing - The delta in memstore size will be passed back via this. This will include both data size and heap overhead delta.

add

public void add(Cell cell,
                MemStoreSizing memstoreSizing)

Description copied from interface: MemStore

Write an update

Specified by:

add in interface MemStore

memstoreSizing - The delta in memstore size will be passed back via this. This will include both data size and heap overhead delta.

upsert

public void upsert(Iterable<Cell> cells,
                   long readpoint,
                   MemStoreSizing memstoreSizing)

Description copied from interface: MemStore

Update or insert the specified cells.

For each Cell, insert into MemStore. This will atomically upsert the value for that row/family/qualifier. If a Cell did already exist, it will then be removed.

Currently the memstoreTS is kept at 0 so as each insert happens, it will be immediately visible. May want to change this so it is atomic across all KeyValues.

This is called under row lock, so Get operations will still see updates atomically. Scans will only see each KeyValue update as atomic.

Specified by:

upsert in interface MemStore

readpoint - readpoint below which we can safely remove duplicate Cells.

memstoreSizing - The delta in memstore size will be passed back via this. This will include both data size and heap overhead delta.

timeOfOldestEdit

public long timeOfOldestEdit()

Specified by:

timeOfOldestEdit in interface MemStore

Returns:

Oldest timestamp of all the Cells in the MemStore

clearSnapshot

public void clearSnapshot(long id)
                   throws UnexpectedStateException

The passed snapshot was successfully persisted; it can be let go.

Specified by:

clearSnapshot in interface MemStore

Parameters:

id - Id of the snapshot to clean out.

Throws:

UnexpectedStateException

See Also:

MemStore.snapshot()

getSnapshotSize

public MemStoreSize getSnapshotSize()

Description copied from interface: MemStore

Return the size of the snapshot(s) if any

Specified by:

getSnapshotSize in interface MemStore

Returns:

size of the memstore snapshot

toString

public String toString()

Overrides:

toString in class Object

getConfiguration

protected org.apache.hadoop.conf.Configuration getConfiguration()

dump

protected void dump(org.slf4j.Logger log)

getLowest

protected Cell getLowest(Cell a,
                         Cell b)

getNextRow

protected Cell getNextRow(Cell key,
                          NavigableSet<Cell> set)

keySize

protected abstract long keySize()

Returns:

The total size of cells in this memstore. We will not consider cells in the snapshot

heapSize

protected abstract long heapSize()

Returns:

The total heap size of cells in this memstore. We will not consider cells in the snapshot

getComparator

protected CellComparator getComparator()

checkActiveSize

protected abstract void checkActiveSize()

Check whether anything need to be done based on the current active set size

getSegments

protected abstract List<Segment> getSegments()
                                      throws IOException

Returns:

an ordered list of segments from most recent to oldest in memstore

Throws:

IOException