Easy and fast backup (and recovery!) for huge PostgreSQL instances at AWS

Comments: No Comments
Published on: 01/02/2016

Usually you have several options when you want to backup PostgreSQL instances. First stop would be the offical doc. But at some point dumping data, or stopping the instance would not be enough. Of course, you could also go for the incremental backups using the Write Ahead Log (WAL).

But what if you want fast backups, with fast recovery, and your instance is really huge? (more…)

ebs-changer: How to change between EBS volume types (or number of PIOPs) in a fast and reliable way

Comments: No Comments
Published on: 07/11/2013

NOTE: ebs-changer is no longer maintained, as is now included into EBS-Tools suite

Did you ever want to change standard EBS to io1 volumes on Amazon Web Services? Maybe io1 to standard? Did you want to increase the number of PIOPs your volumes are using? Did you performed this tedious job by hand?

In my current project (SmartSteps) at Telefonica R&D we needed to to this a lot of times on several environments using MongoDB replicasets and RAID0 on each mongo server.

So each time we needed to stop mongo services (or the instances), snapshot all the volumes, detach, delete old volumes, create new volumes from the snapshots and then reattach them using the same devices. That was more than 15 times the same set of operations.

And of course, it was likely possible to make mistakes in the process.

So, why should we do this by hand when it’s possible to automate and run the changes in parallel? (more…)

How to check if a database exists on MongoDB

Categories: Databases
Comments: No Comments
Published on: 01/05/2013

Why do you need this?

Just suppose you want to backup a Mongo database using mongodump.

As backups for individual databases don’t support –oplog, you may want to make sure you get a consistent database and therefore you decide to use fsyncLock() to flush any pending write operation and to lock new writes until your task is finished (do this only over secondary nodes on replica sets)

But then you launch mongodump against the MongoDB node… and the task keeps waiting for something…

(more…)

page 1 of 1

Jenkins Status
ebs-tools
nexus2-openshift
nexus3-openshift
nexus-oss-rpms
s3fs-fuse-rpm
tds_fdw
full-backup
Follow Me
GithubLinkedIn
Account

Welcome , today is Friday, 28/07/2017