rt

为了“和谐”是纵容劣币驱逐良币的合法借口,无论是公司还是国家
发表在 其他 | 标签为 | 留下评论

about Redis replication partial resync

Designing Redis replication partial resync  http://antirez.com/news/31

Partial resyncs and synchronous replication. http://antirez.com/news/45

 

发表在 Redis | 留下评论

twitter 消息分发的一些资料

Real-Time Delivery Architecture at Twitter http://www.infoq.com/presentations/Real-Time-Delivery-Twitter

722cf283tw1e06559k2r9j

 

发表在 同步技术 | 留下评论

关于twemproxy的一些资料

https://github.com/twitter/twemproxy

Twemproxy, a Redis proxy from Twitter : http://antirez.com/news/44

发表在 Redis | 留下评论

关于mysql innodb .ibd文件恢复的一些收集

不翻译,不总结,用的比较少,需要的时候根据文档来操作就够了。如果能够理解为什么更好
1,MySQL单表ibd文件恢复 http://ourmysql.com/archives/1136
2,Percona Data Recovery Tool for InnoDB https://launchpad.net/percona-data-recovery-tool-for-innodb
3,Recovering an InnoDB table from only an .ibd file. http://www.chriscalender.com/?p=28
4,Connecting orphaned .ibd files http://www.mysqlperformanceblog.com/2011/05/13/connecting-orphaned-ibd-files/
5,InnoDB transportable tablespaces http://blogs.innodb.com/wp/2012/04/innodb-transportable-tablespaces/
6,How to recover a single InnoDB table from a Full Backup http://www.mysqlperformanceblog.com/2012/01/25/how-to-recover-a-single-innodb-table-from-a-full-backup/

发表在 MySQL | 留下评论

nsq的一些资料

https://github.com/bitly/nsq

https://github.com/bitly/nsq/blob/master/docs/design.md#delivery

https://speakerdeck.com/snakes/nsq-nyc-golang-meetup

https://github.com/davegardnerisme/nsqphp

http://word.bitly.com/post/33232969144/nsq 【NSQ: realtime distributed message processing at scale

发表在 GoLang | 标签为 , | 留下评论

关于TCP Fast Open(TFO)的一些资料收集,准备慢慢看

http://packetpushers.net/tcp-fast-curious-a-look-at-tcp-fast-open/

http://en.wikipedia.org/wiki/TCP_Fast_Open

http://lwn.net/Articles/508865/

https://developers.google.com/speed/

http://tools.ietf.org/html/draft-ietf-tcpm-proportional-rate-reduction-00

http://www.linuxplumbersconf.org/2011/ocw/events/LPC2011MC/proposals

https://developers.google.com/speed/protocols/tcpm-IW10

http://research.google.com/pubs/pub36640.html

http://research.google.com/pubs/pub37517.html

http://research.google.com/pubs/pub36640.html

https://datatracker.ietf.org/doc/draft-cheng-tcpm-fastopen/

http://research.google.com/pubs/pub37486.html

 

发表在 TCP | 标签为 , , , | 留下评论

几个图片滤镜地址

android实时滤镜

http://www.jhlabs.com/ip/filters/index.html

Android大图片裁剪终极解决方案(上:原理分析)http://my.oschina.net/ryanhoo/blog/86842

 

Instagram Filters几十种滤镜效果 http://appcodes.org/imageview/435.html

所见所得捕捉光影——实时滤镜创新二三点 http://cdc.tencent.com/?p=5695

 

 

QQ影像 for iPhone 设计分享 http://cdc.tencent.com/?p=6022

http://www.imagemagick.org/download/iOS/

http://www.google.com/codesearch#I0cABDTB4TA/pub/FreeBSD/ports/distfiles/ImageMagick-6.3.2-0.tar.bz2%7Cqy9T8VaIuJE/ImageMagick-6.3.2/magick/effect.c

http://www.imagemagick.org/script/binary-releases.php?ImageMagick=6v1763klfqgboqosn68v8qa7k3#iOS

http://www.imagemagick.org/script/license.php

https://github.com/esilverberg/ios-image-filters

http://homepages.inf.ed.ac.uk/rbf/HIPR2/hipr_top.htm

http://stackoverflow.com/questions/3928862/instagram-image-filters-on-iphone

http://en.wikipedia.org/wiki/Canny_edge_detection

Simple Image Filter using OpenGL ES in Android

http://www.multunus.com/2011/10/simple-image-filter-using-opengl-es-in-android/

A Library of OpenGL-based Mathematical Image Filters

http://martin.von-gagern.net/publications/2010-icms/

OpenGL ES Tutorial for Android – Part V – More on Meshes

http://blog.jayway.com/2010/02/15/opengl-es-tutorial-for-android-%E2%80%93-part-v/
http://slick.cokeandcode.com/javadoc/org/newdawn/slick/Image.html
发表在 Android 开发 | 留下评论

mysql优化中常用的公式

Per-Thread Buffer memory utilization
(read_buffer_size + read_rnd_buffer_size + sort_buffer_size + thread_stack + join_buffer_size + binlog_cache_size) * max_connections

Global Buffer memory utilization
innodb_buffer_pool_size + innodb_additional_mem_pool_size + innodb_log_buffer_size + key_buffer_size + query_cache_size

Threads and Connections
thread_cache miss rate = Threads_created / Connections
connection ratio = (max_used_connections*100)/ max_connections
threads_per_second = threads_created / uptime

Key Buffer
key_buffer_free = (key_blocks_unused * key_cache_block_size) / (key_buffer_size * 100)
key_cache_miss_rate = key_read_requests / key_reads

Query Cache
query_cache_used_memory = query_cache_size – Qcache_free_memory
query_cache_mem_fill_ratio = ((query_cache_size – Qcache_free_memory) * 100) / query_cache_size
query_cache_percent_fragmented = (Qcache_free_blocks * 100) / Qcache_total_blocks

Sorting
total_sorts = sort_scan + sort_range
passes_per_sort = sort_merge_passes / total_sorts

Open Files
open_files_ratio = (open_files*100) / open_files_limit
if open_files_ratio > 80: increase open_files_limit

Table Cache
table_cache_hit_rate = (open_tables*100) / opened_tables
table_cache_fill = (open_tables*100) / table_cache
if table_cache_fill < 95 && > 90: all good
if table_cache_fill < 90: decrease table_cache

Table Locks
table_lock_miss_rate = table_locks_immediate / table_locks_waited
if table_lock_miss_rate > 4096: set concurrent_insert=2 and low_priority_updates=1

Table Scans
full_table_scans= Handler_read_rnd_next / Com_select
if full_table_scans > 4096: increase read_buffer and read_rnd_buffer

Join Buffer
if Select_full_join > 0: increase join_buffer
if Select_range_check > 0: increase join buffer
if Select_full_join = 0: join_buffer fine
if Select_range_check = 0: join buffer fine

Temp tables
tmp_disk_tables= (created_tmp_disk_tables * 100)/( Created_tmp_tables + Created_tmp_disk_tables )
if tmp_disk_tables > 32: increase tmp_table_size

InnoDB
innodb_buffer_pool_free_perc = (innodb_buffer_pool_pages_free*100) / innodb_buffer_pool_pages_total
innodb_index_size = SELECT SUM(INDEX_LENGTH) from information_schema.TABLES where ENGINE=’innodb’
innodb_data_size = SELECT SUM(DATA_LENGTH from information_schema.TABLES where ENGINE=’innodb’

发表在 同步技术 | 5条评论

puppet 部署 multi instance mysql 和 redis

把近期主要动手做的事情总结了一下,代码和配置也放到了github上,对于一台服务器上部署多个redis和mysql,可以参考 http://t.cn/zWLkM2chttp://t.cn/zWLkM2t RHlinux风格的配置和操作,不喜勿视

发表在 同步技术 | 留下评论