设为首页 收藏本站
查看: 1435|回复: 0

[经验分享] MySQL 分区表 partition线上修改分区字段,后续进一步学习partition (2) --> 子分区以及对录入Null值的处理情况.

[复制链接]

尚未签到

发表于 2016-10-24 05:21:20 | 显示全部楼层 |阅读模式
  -- MySQL分区, 子分区以及对录入Null值的处理情况.看完官方文档做的笔记.
  -- KEY Partitioning
Partitioning by key is similar to partitioning by hash, except that where hash partitioning employs a user-defined expression, the hashing function for key partitioning is supplied by the MySQL server. This internal hashing function is based on the
same algorithm as PASSWORD().

KEY is used rather than HASH.

KEY takes only a list of one or more column names. The column or columns used as the partitioning key must comprise part or all of the table's primary key, if the table has one.

KEY takes a list of zero or more column names. Where no column name is specified as the partitioning key, the table's primary key is used, if there is one. For example, the following CREATE TABLE statement is valid in MySQL 5.5:


mysql> CREATE TABLE k1 (
->     id INT NOT NULL PRIMARY KEY,
->     name VARCHAR(20)
-> )
-> PARTITION BY KEY()
-> PARTITIONS 2;
Query OK, 0 rows affected (0.06 sec)
If there is no primary key but there is a unique key, then the unique key is used for the partitioning key:
mysql> CREATE TABLE k2 (
->     id INT NOT NULL,
->     name VARCHAR(20),
->     UNIQUE KEY (id)
-> )
-> PARTITION BY KEY()
-> PARTITIONS 2;
Query OK, 0 rows affected (0.02 sec)

  

However, if the unique key column were not defined as NOT NULL, then the previous statement would fail.
  In both of these cases, the partitioning key is the id column, even though it is not shown in the output of SHOW CREATE TABLE or in the PARTITION_EXPRESSION column of the INFORMATION_SCHEMA.PARTITIONS table.

As below:


mysql>  SELECT t.TABLE_NAME, t.PARTITION_NAME,t.TABLE_ROWS  FROM INFORMATION_SCHEMA.PARTITIONS t WHERE table_name='k2';
+------------+----------------+------------+
| TABLE_NAME | PARTITION_NAME | TABLE_ROWS |
+------------+----------------+------------+
| k2         | p0             |          3 |
| k2         | p1             |          4 |
+------------+----------------+------------+
2 rows in set (0.01 sec)

  Unlike the case with other partitioning types, columns used for partitioning by KEY are not restricted to integer or NULL values.

For example, the following CREATE TABLE statement is valid:
没有primary key,没有在定义时候指定分区字段,会抱错:


mysql> CREATE TABLE tm3 (
->     s1 CHAR(32)
-> )
-> PARTITION BY KEY()
-> PARTITIONS 10;
ERROR 1488 (HY000): Field in list of fields for partition function not found in table
在定义中加入分区字段,add the column in define , it is ok
mysql> CREATE TABLE tm3 (
->     s1 CHAR(32)
-> )
-> PARTITION BY KEY(s1)
-> PARTITIONS 10;
Query OK, 0 rows affected (0.07 sec)
mysql>

  
  子分区 Subpartitioning
Subpartitioning—also known as composite partitioning—is the further division of each partition in a partitioned table.

For example, consider the following CREATE TABLE statement:

mysql> CREATE TABLE ts (id INT, purchased DATE)
->     PARTITION BY RANGE( YEAR(purchased) )
->     SUBPARTITION BY HASH( TO_DAYS(purchased) ) (
->         PARTITION p0 VALUES LESS THAN (1990) (
->             SUBPARTITION s0,
->             SUBPARTITION s1
->         ),
->         PARTITION p1 VALUES LESS THAN (2000) (
->             SUBPARTITION s2,
->             SUBPARTITION s3
->         ),
->         PARTITION p2 VALUES LESS THAN MAXVALUE (
->             SUBPARTITION s4,
->             SUBPARTITION s5
->         )
->     );
Query OK, 0 rows affected (0.04 sec)

CREATE TABLE ts3 (id INT, purchased DATE)
PARTITION BY RANGE( YEAR(purchased) )
SUBPARTITION BY HASH( TO_DAYS(purchased) ) (
PARTITION p0 VALUES LESS THAN (1990) (
SUBPARTITION s0,
SUBPARTITION s1
),
PARTITION p1 VALUES LESS THAN (2000),
PARTITION p2 VALUES LESS THAN MAXVALUE (
SUBPARTITION s2,
SUBPARTITION s3
)
);

  
  (1) Each partition must have the same number of subpartitions. if not ,fail


mysql> CREATE TABLE ts3 (id INT, purchased DATE)
->     PARTITION BY RANGE( YEAR(purchased) )
->     SUBPARTITION BY HASH( TO_DAYS(purchased) ) (
->         PARTITION p0 VALUES LESS THAN (1990) (
->             SUBPARTITION s0,
->             SUBPARTITION s1
->         ),
->         PARTITION p1 VALUES LESS THAN (2000),
->         PARTITION p2 VALUES LESS THAN MAXVALUE (
->             SUBPARTITION s2,
->             SUBPARTITION s3
->         )
->     );
ERROR 1064 (42000): Wrong number of subpartitions defined, mismatch with previous setting near '
PARTITION p2 VALUES LESS THAN MAXVALUE (
SUBPARTITION s2,
' at line 8
mysql>

  

(2) Each SUBPARTITION clause must include (at a minimum) a name for the subpartition.
  Otherwise, you may set any desired option for the subpartition or allow it to assume its default setting for that option.
  
(3) Subpartition names must be unique across the entire table.
  
(4) Subpartitions can be used with especially large tables to distribute data and indexes across many disks. Suppose that you have 6 disks mounted as /disk0, /disk1, /disk2, and so on. Now consider the following example:

mysql> CREATE TABLE ts5 (id INT, purchased DATE)
->     PARTITION BY RANGE( YEAR(purchased) )
->     SUBPARTITION BY HASH( TO_DAYS(purchased) ) (
->         PARTITION p0 VALUES LESS THAN (1990) (
->             SUBPARTITION s0
->                 DATA DIRECTORY = '/disk0/data'
->                 INDEX DIRECTORY = '/disk0/idx',
->             SUBPARTITION s1
->                 DATA DIRECTORY = '/disk1/data'
->                 INDEX DIRECTORY = '/disk1/idx'
->         ),
->         PARTITION p1 VALUES LESS THAN (2000) (
->             SUBPARTITION s2
->                 DATA DIRECTORY = '/disk2/data'
->                 INDEX DIRECTORY = '/disk2/idx',
->             SUBPARTITION s3
->                 DATA DIRECTORY = '/disk3/data'
->                 INDEX DIRECTORY = '/disk3/idx'
->         ),
->         PARTITION p2 VALUES LESS THAN MAXVALUE (
->             SUBPARTITION s4
->                 DATA DIRECTORY = '/disk4/data'
->                 INDEX DIRECTORY = '/disk4/idx',
->             SUBPARTITION s5
->                 DATA DIRECTORY = '/disk5/data'
->                 INDEX DIRECTORY = '/disk5/idx'
->         )
->     );
Query OK, 0 rows affected (0.04 sec)
In this case, a separate disk is used for the data and for the indexes of each RANGE. Many other variations are possible;
another example might be:
mysql> CREATE TABLE ts6 (id INT, purchased DATE)
->     PARTITION BY RANGE(YEAR(purchased))
->     SUBPARTITION BY HASH( TO_DAYS(purchased) ) (
->         PARTITION p0 VALUES LESS THAN (1990) (
->             SUBPARTITION s0a
->                 DATA DIRECTORY = '/disk0'
->                 INDEX DIRECTORY = '/disk1',
->             SUBPARTITION s0b
->                 DATA DIRECTORY = '/disk2'
->                 INDEX DIRECTORY = '/disk3'
->         ),
->         PARTITION p1 VALUES LESS THAN (2000) (
->             SUBPARTITION s1a
->                 DATA DIRECTORY = '/disk4/data'
->                 INDEX DIRECTORY = '/disk4/idx',
->             SUBPARTITION s1b
->                 DATA DIRECTORY = '/disk5/data'
->                 INDEX DIRECTORY = '/disk5/idx'
->         ),
->         PARTITION p2 VALUES LESS THAN MAXVALUE (
->             SUBPARTITION s2a,
->             SUBPARTITION s2b
->         )
->     );
Query OK, 0 rows affected (0.04 sec)

  

  In future, when the number of purchases for the decade beginning with the year 2000 grows to a point where the default location no longer provides sufficient space, the corresponding rows can be moved using an ALTER TABLE ... REORGANIZE PARTITION statement.
See Section 17.3, “Partition Management”, for an explanation of how this can be done.
  

The DATA DIRECTORY and INDEX DIRECTORY options are disallowed in partition definitions when the NO_DIR_IN_CREATE server SQL mode is in effect. Beginning with MySQL 5.5.5, these options are also disallowed when defining subpartitions (Bug#42954).
  How MySQL Partitioning Handles NULL
Partitioning in MySQL does nothing to disallow NULL as the value of a partitioning expression,

whether it is a column value or the value of a user-supplied expression. Even though it is permitted to use NULL as the value of an expression that must otherwise yield an integer, it is important to keep in mind that NULL is not a number. MySQL's partitioning
implementation treats NULL as being less than any non-NULL value, just as ORDER BY does.
  
  This means that treatment of NULL varies between partitioning of different types, and may produce behavior which you do not expect if you are not prepared for it.

This being the case, we discuss in this section how each MySQL partitioning type handles NULL values when determining the partition in which a row should be stored,

and provide examples for each.
  
  Handling of NULL with RANGE partitioning. If you insert a row into a table partitioned by RANGE such that the column value used to determine the partition is NULL,

the row is inserted into the lowest partition. For example, consider these two tables in a database named p, created as follows:
  
  (1) Rang Partition,OK
You can see the partitions created by these two CREATE TABLE statements using the following query against the PARTITIONS table in the INFORMATION_SCHEMA database:


mysql> SELECT TABLE_NAME, PARTITION_NAME, TABLE_ROWS, AVG_ROW_LENGTH, DATA_LENGTH
->    FROM INFORMATION_SCHEMA.PARTITIONS
->     WHERE TABLE_SCHEMA = 'test' AND TABLE_NAME LIKE 't_';
+------------+----------------+------------+----------------+-------------+
| TABLE_NAME | PARTITION_NAME | TABLE_ROWS | AVG_ROW_LENGTH | DATA_LENGTH |
+------------+----------------+------------+----------------+-------------+
| t1         | p0             |          0 |              0 |       16384 |
| t1         | p1             |          0 |              0 |       16384 |
| t1         | p2             |          0 |              0 |       16384 |
| t2         | p0             |          0 |              0 |       16384 |
| t2         | p1             |          0 |              0 |       16384 |
| t2         | p2             |          0 |              0 |       16384 |
| t2         | p3             |          0 |              0 |       16384 |
| ts         | p0             |          0 |              0 |       16384 |
| ts         | p0             |          0 |              0 |       16384 |
| ts         | p1             |          0 |              0 |       16384 |
| ts         | p1             |          0 |              0 |       16384 |
| ts         | p2             |          0 |              0 |       16384 |
| ts         | p2             |          0 |              0 |       16384 |
+------------+----------------+------------+----------------+-------------+
14 rows in set (0.00 sec)

  
  Now let us populate each of these tables with a single row containing a NULL in the column used as the partitioning key,

and verify that the rows were inserted using a pair of SELECT statements:
  You can see which partitions are used to store the inserted rows by rerunning the previous query against INFORMATION_SCHEMA.PARTITIONS and inspecting the output:

mysql> INSERT INTO t1 VALUES (NULL, 'mothra');
Query OK, 1 row affected (0.00 sec)
mysql> INSERT INTO t2 VALUES (NULL, 'mothra');
Query OK, 1 row affected (0.00 sec)
mysql> SELECT * FROM t1;
+------+--------+
| c1   | c2     |
+------+--------+
| NULL | mothra |
+------+--------+
1 row in set (0.01 sec)
mysql> SELECT * FROM t2;
+------+--------+
| c1   | c2     |
+------+--------+
| NULL | mothra |
+------+--------+
1 row in set (0.00 sec)
mysql> SELECT TABLE_NAME, PARTITION_NAME, TABLE_ROWS, AVG_ROW_LENGTH, DATA_LENGTH    FROM INFORMATION_SCHEMA.PARTITIONS   
WHERE TABLE_SCHEMA = 'test' AND TABLE_NAME LIKE 't_';
+------------+----------------+------------+----------------+-------------+
| TABLE_NAME | PARTITION_NAME | TABLE_ROWS | AVG_ROW_LENGTH | DATA_LENGTH |
+------------+----------------+------------+----------------+-------------+
| t1         | p0             |          1 |          16384 |       16384 |
| t1         | p1             |          0 |              0 |       16384 |
| t1         | p2             |          0 |              0 |       16384 |
| t2         | p0             |          1 |          16384 |       16384 |
| t2         | p1             |          0 |              0 |       16384 |
| t2         | p2             |          0 |              0 |       16384 |
| t2         | p3             |          0 |              0 |       16384 |
| ts         | p0             |          0 |              0 |       16384 |
| ts         | p0             |          0 |              0 |       16384 |
| ts         | p1             |          0 |              0 |       16384 |
| ts         | p1             |          0 |              0 |       16384 |
| ts         | p2             |          0 |              0 |       16384 |
| ts         | p2             |          0 |              0 |       16384 |
+------------+----------------+------------+----------------+-------------+
13 rows in set (0.00 sec)

You can also demonstrate that these rows were stored in the lowest partition of each table by dropping these partitions,
and then re-running the SELECT statements:

  (2) Handling of NULL with LIST partitioning. 必须将null在定义中加入才能录入null的分区数据


mysql> CREATE TABLE ts3 (
->     c1 INT,
->     c2 VARCHAR(20)
-> )
-> PARTITION BY LIST(c1) (
->     PARTITION p0 VALUES IN (0, 3, 6),
->     PARTITION p1 VALUES IN (1, 4, 7, NULL),
->     PARTITION p2 VALUES IN (2, 5, 8)
-> );
Query OK, 0 rows affected (0.01 sec)

  否则insert null的分区数据会抱错:
ERROR 1504 (HY000): Table has no partition for value NULL

  
  (3) Handling of NULL with HASH and KEY partitioning.


mysql> CREATE TABLE th (
->     c1 INT,
->     c2 VARCHAR(20)
-> )
-> PARTITION BY HASH(c1)
-> PARTITIONS 2;
Query OK, 0 rows affected (0.00 sec)
There is no data record in beginnig.
mysql>   SELECT TABLE_NAME,PARTITION_NAME,TABLE_ROWS,AVG_ROW_LENGTH,DATA_LENGTH
->          FROM INFORMATION_SCHEMA.PARTITIONS
->          WHERE TABLE_SCHEMA = 'test' AND TABLE_NAME ='th';
+------------+----------------+------------+----------------+-------------+
| TABLE_NAME | PARTITION_NAME | TABLE_ROWS | AVG_ROW_LENGTH | DATA_LENGTH |
+------------+----------------+------------+----------------+-------------+
| th         | p0             |          0 |              0 |       16384 |
| th         | p1             |          0 |              0 |       16384 |
+------------+----------------+------------+----------------+-------------+
2 rows in set (0.00 sec)
mysql> INSERT INTO th VALUES (NULL, 'mothra'), (0, 'gigan');
Query OK, 2 rows affected (0.00 sec)
Records: 2  Duplicates: 0  Warnings: 0
mysql> SELECT * FROM th;
+------+--------+
| c1   | c2     |
+------+--------+
| NULL | mothra |
|    0 | gigan  |
+------+--------+
2 rows in set (0.00 sec)
mysql>   SELECT TABLE_NAME,PARTITION_NAME,TABLE_ROWS,AVG_ROW_LENGTH,DATA_LENGTH
->          FROM INFORMATION_SCHEMA.PARTITIONS
->          WHERE TABLE_SCHEMA = 'test' AND TABLE_NAME ='th';
+------------+----------------+------------+----------------+-------------+
| TABLE_NAME | PARTITION_NAME | TABLE_ROWS | AVG_ROW_LENGTH | DATA_LENGTH |
+------------+----------------+------------+----------------+-------------+
| th         | p0             |          2 |           8192 |       16384 |
| th         | p1             |          0 |              0 |       16384 |
+------------+----------------+------------+----------------+-------------+
2 rows in set (0.00 sec)

  Recall that for any integer N, the value of NULL MOD N is always NULL. For tables that are partitioned by HASH or KEY, this result is treated for determining the correct partition as 0. Checking the INFORMATION_SCHEMA.PARTITIONS table once again, we can
see that both rows were inserted into partition p0:
  
  MySQL对分区中null值得处理, rang,key,以及hash中,都是直接放入min的分区中. list分区中则是放入事先定义好的包含null的分区中,如果list分区事先没有定义包含null值的分区,那么录入的时候会抱错

运维网声明 1、欢迎大家加入本站运维交流群:群②:261659950 群⑤:202807635 群⑦870801961 群⑧679858003
2、本站所有主题由该帖子作者发表,该帖子作者与运维网享有帖子相关版权
3、所有作品的著作权均归原作者享有,请您和我们一样尊重他人的著作权等合法权益。如果您对作品感到满意,请购买正版
4、禁止制作、复制、发布和传播具有反动、淫秽、色情、暴力、凶杀等内容的信息,一经发现立即删除。若您因此触犯法律,一切后果自负,我们对此不承担任何责任
5、所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其内容的准确性、可靠性、正当性、安全性、合法性等负责,亦不承担任何法律责任
6、所有作品仅供您个人学习、研究或欣赏,不得用于商业或者其他用途,否则,一切后果均由您自己承担,我们对此不承担任何法律责任
7、如涉及侵犯版权等问题,请您及时通知我们,我们将立即采取措施予以解决
8、联系人Email:admin@iyunv.com 网址:www.yunweiku.com

所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其承担任何法律责任,如涉及侵犯版权等问题,请您及时通知我们,我们将立即处理,联系人Email:kefu@iyunv.com,QQ:1061981298 本贴地址:https://www.yunweiku.com/thread-290335-1-1.html 上篇帖子: php如何将图片gif,jpg或mysql longblob或blob字段值转换成16进制字符串! 下篇帖子: 编译安装MySQL5.1.41
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

扫码加入运维网微信交流群X

扫码加入运维网微信交流群

扫描二维码加入运维网微信交流群,最新一手资源尽在官方微信交流群!快快加入我们吧...

扫描微信二维码查看详情

客服E-mail:kefu@iyunv.com 客服QQ:1061981298


QQ群⑦:运维网交流群⑦ QQ群⑧:运维网交流群⑧ k8s群:运维网kubernetes交流群


提醒:禁止发布任何违反国家法律、法规的言论与图片等内容;本站内容均来自个人观点与网络等信息,非本站认同之观点.


本站大部分资源是网友从网上搜集分享而来,其版权均归原作者及其网站所有,我们尊重他人的合法权益,如有内容侵犯您的合法权益,请及时与我们联系进行核实删除!



合作伙伴: 青云cloud

快速回复 返回顶部 返回列表