io - Heavy replication write load on MySQL slave -

-

we using percona mysql 5.6 on debian 8 ecommerce aggregator. there master backend server doing whole etl (processing product feeds partners) , slave mysql server used frontend web servers. it's single product database 600gb data.

both machines have raid10 datacenter series ssds. master mysql dual xeon e5 128gb ram , slave single xeon e5 64gb ram. our problem is, etl i/o heavy (with thousands of iops), master able handle i/o load slave server cannot keep replication. work done in ramdisk , real neccessary data written database, already.

the slave has more reads writes, replication cannot catch up. options there scaling replication writes (i.e. i/o load) on slave?

edit 2016-11-18: "options" i'm not asking optimizing mysql, other techniques or software handle situation better.

upgrading 5.7 should solve immediate problem: http://mysqlhighavailability.com/multi-threaded-replication-performance-in-mysql-5-7/.

this precursor master running out of write capacity. should start thinking sharding soon. can check out youtube's vitess.io project, i'm part of.


Comments

Post a Comment

Popular posts from this blog

Formatting string according to pattern without regex in php -

-
how can format arbitrary string according flexible pattern? solution came using regular expressions, need 2 "patterns" (one search , 1 output). example: $str = '123abc5678"; desired output: 12.3ab-c5-67.8 i use pattern in variable (one user can define without knowledge of regular expressions) this: $pattern = '%%.%%%-%%-%%.%'; so user have use 2 different characters (% , .) a solution regex this: $str = '123abc5678'; $pattern_src = '@(.{2})(.{3})(.{2})(.{2})(.{1})@'; $pattern_rpl = "$1.$2-$3-$4.$5"; $res = preg_replace($pattern_src, $pattern_rpl, $str); //$res eq 12.3ab-c5-67.8 way complicated since user need define $pattern_src , $pattern_rpl. if string vary in length, more complex explain. yes, write function/parser builds required regular expressions based on simple user pattern %%.%%%-%%-%%.%. wonder if there "built in" way achieve php? thinking sprintf etc., doesn't seem trick. ideas? ...
Read more

c - zlib and gdi32 with OpenSSL? -

-
this follow question undefined reference rsa_generate_key in openssl? have openssl program generate rsa key, follows : #include <stdio.h> #include <openssl/rsa.h> #include <openssl/pem.h> int main(int argc, char* argv[]) { rsa *r = null; int ret; r = rsa_new(); bignum *bne = null; ret = rsa_generate_key_ex(r, 2048, bne, null); return 0; } when compile gcc -i../include rsatest.c -lcrypto -l. i undefined reference errors functions in libraries gdi32 , zlib. so correct this, have add -lz , -lgdi32, as gcc -i../include/ rsatest.c -lcrypto -lz -lgdi32 -l. my question is, aren't static libcrypto , libssl self sufficient? in why having add libraries make work? there option should have added while compiling library prevent this? i'm using 64 bit windows mingw compiler. made openssl library of msys , make.
Read more

java - inputmismatch exception -

-
Image
this question has answer here: scanner skipping nextline() after using next(), nextint() or other nextfoo()? 14 answers import java.util.*; public class ngg { static scanner numberentered; static scanner userinput = new scanner(system.in); static int guessednumber; static int randomnumber = (int) (math.random()* 11); static scanner reply; static string answer; public static void main(string[] args) { guesschecker(guessednumber); } public static void guesschecker(int userguess) { while (userguess != randomnumber) { intro(); userguess = intchecker(); if (userguess == randomnumber) { system.out.println("congradulations!"); system.exit(0); } else { system.out.println("that incorrect!");...
Read more