Re: [patch 00/15] CFS Bandwidth Control V6

From: Hu Tao
Date: Tue Jun 14 2011 - 02:58:44 EST

Hi,

I've run several tests including hackbench, unixbench, massive-intr
and kernel building. CPU is Intel(R) Xeon(R) CPU X3430 @ 2.40GHz,
4 cores, and 4G memory.

Most of the time the results differ few, but there are problems:

1. unixbench: execl throughout has about 5% drop.
2. unixbench: process creation has about 5% drop.
3. massive-intr: when running 200 processes for 5mins, the number
of loops each process runs differ more than before cfs-bandwidth-v6.

The results are attached.
004726 00000761
004723 00000763
004793 00000763
004776 00000736
004746 00000735
004731 00000754
004685 00000735
004835 00000754
004782 00000751
004747 00000736
004766 00000754
004663 00000735
004696 00000752
004737 00000760
004679 00000735
004727 00000751
004840 00000754
004720 00000767
004718 00000764
004788 00000761
004716 00000770
004791 00000758
004655 00000755
004838 00000757
004811 00000753
004659 00000768
004686 00000735
004740 00000759
004676 00000739
004849 00000748
004825 00000763
004808 00000748
004844 00000747
004702 00000755
004828 00000758
004829 00000758
004822 00000750
004820 00000753
004805 00000751
004764 00000748
004717 00000765
004794 00000761
004701 00000750
004792 00000766
004818 00000753
004842 00000752
004837 00000751
004697 00000750
004654 00000739
004763 00000754
004851 00000761
004671 00000738
004807 00000753
004734 00000760
004661 00000740
004743 00000737
004664 00000740
004682 00000737
004741 00000750
004817 00000750
004694 00000754
004779 00000753
004833 00000754
004758 00000757
004809 00000756
004815 00000752
004666 00000758
004770 00000750
004704 00000737
004709 00000753
004841 00000754
004732 00000753
004706 00000753
004675 00000739
004745 00000737
004719 00000765
004691 00000764
004777 00000756
004778 00000750
004780 00000759
004754 00000737
004799 00000755
004848 00000755
004752 00000737
004742 00000734
004773 00000752
004774 00000747
004673 00000736
004787 00000763
004781 00000756
004693 00000753
004692 00000751
004769 00000750
004728 00000763
004756 00000758
004749 00000737
004762 00000753
004687 00000739
004827 00000766
004683 00000734
004761 00000757
004678 00000739
004830 00000763
004803 00000763
004798 00000765
004850 00000760
004771 00000749
004674 00000737
004832 00000753
004821 00000757
004753 00000734
004843 00000752
004724 00000763
004759 00000752
004800 00000753
004700 00000753
004824 00000763
004767 00000755
004823 00000751
004789 00000768
004757 00000755
004852 00000765
004836 00000756
004839 00000757
004760 00000748
004834 00000758
004739 00000759
004786 00000768
004846 00000754
004711 00000761
004826 00000765
004695 00000755
004710 00000758
004783 00000761
004765 00000755
004684 00000731
004698 00000752
004785 00000768
004755 00000736
004813 00000754
004775 00000753
004795 00000765
004712 00000755
004768 00000755
004713 00000767
004816 00000752
004790 00000765
004744 00000731
004736 00000756
004672 00000741
004715 00000766
004667 00000754
004705 00000755
004810 00000755
004708 00000755
004707 00000752
004750 00000736
004688 00000736
004772 00000741
004703 00000736
004681 00000736
004748 00000737
004668 00000736
004690 00000739
004669 00000739
004733 00000743
004656 00000767
004812 00000749
004714 00000771
004677 00000741
004806 00000755
004665 00000736
004680 00000739
004670 00000739
004663 00000754
004634 00000694
004723 00000800
004746 00000751
004734 00000768
004633 00000689
004755 00000754
004722 00000797
004626 00000797
004689 00000765
004767 00000695
004813 00000765
004724 00000800
004621 00000769
004725 00000796
004714 00000799
004789 00000793
004631 00000758
004712 00000796
004744 00000748
004655 00000796
004783 00000751
004785 00000800
004790 00000796
004758 00000748
004816 00000772
004683 00000765
004636 00000694
004771 00000691
004619 00000695
004669 00000753
004623 00000696
004775 00000753
004752 00000748
004778 00000754
004784 00000751
004739 00000767
004807 00000762
004693 00000765
004691 00000770
004736 00000763
004709 00000768
004720 00000796
004628 00000695
004772 00000695
004696 00000695
004682 00000692
004675 00000748
004643 00000689
004637 00000695
004715 00000793
004787 00000796
004792 00000793
004797 00000796
004708 00000768
004651 00000796
004806 00000766
004679 00000766
004811 00000763
004699 00000695
004624 00000769
004638 00000695
004645 00000695
004635 00000692
004704 00000692
004742 00000764
004680 00000761
004800 00000796
004796 00000801
004802 00000798
004731 00000793
004677 00000770
004640 00000692
004657 00000692
004656 00000793
004730 00000790
004786 00000795
004817 00000766
004627 00000694
004727 00000793
004814 00000773
004658 00000798
004695 00000689
004791 00000792
004653 00000795
004798 00000792
004673 00000745
004666 00000753
004753 00000751
004664 00000753
004788 00000798
004801 00000753
004685 00000766
004810 00000770
004750 00000753
004754 00000755
004652 00000795
004668 00000753
004654 00000795
004648 00000695
004777 00000747
004765 00000694
004672 00000753
004665 00000750
004737 00000770
004757 00000747
004620 00000796
004780 00000750
004717 00000792
004773 00000751
004756 00000767
004760 00000746
004808 00000770
004776 00000753
004662 00000756
004670 00000750
004625 00000694
004647 00000694
004794 00000795
004738 00000767
004641 00000698
004735 00000767
004759 00000694
004799 00000790
004762 00000697
004629 00000694
004769 00000694
004705 00000694
004743 00000767
004781 00000750
004701 00000697
004661 00000749
004702 00000694
004710 00000770
004681 00000767
004700 00000691
004686 00000767
004642 00000694
004747 00000753
004644 00000694
004812 00000767
004748 00000750
004733 00000764
004721 00000797
004687 00000771
004690 00000771
004751 00000749
004632 00000694
004732 00000764
004728 00000798
004766 00000694
004706 00000764
004630 00000694
004688 00000764
004711 00000694
004622 00000753
004795 00000798
004815 00000770
004729 00000791
004763 00000747
004818 00000766
004674 00000749
004761 00000694
004749 00000752
004770 00000692
004718 00000795
004694 00000694
004782 00000755
004809 00000766
004740 00000770
004671 00000752
004716 00000762
004707 00000766
004692 00000801
004719 00000795
004713 00000800
004659 00000797
004764 00000749
004774 00000747
004698 00000688
004649 00000696
004779 00000752
004768 00000694
004676 00000752
004646 00000693
004805 00000755
004697 00000691
004703 00000692
004639 00000694
004804 00000693
004803 00000754
004678 00000769
004741 00000768
004684 00000761
004660 00000693
004793 00000797
004667 00000753
004726 00000795
004745 00000755
004650 00000691
004544 00000138
004411 00000152
004435 00000154
004408 00000152
004553 00000138
004450 00000138
004540 00000138
004534 00000138
004557 00000138
004545 00000138
004469 00000152
004467 00000152
004521 00000138
004396 00000152
004484 00000152
004556 00000138
004474 00000152
004537 00000138
004489 00000152
004481 00000152
004547 00000138
004587 00000138
004555 00000138
004393 00000152
004480 00000152
004405 00000152
004392 00000152
004475 00000152
004402 00000152
004563 00000135
004524 00000154
004427 00000140
004517 00000154
004431 00000154
004584 00000154
004432 00000154
004418 00000140
004442 00000154
004420 00000140
004443 00000154
004428 00000140
004549 00000154
004466 00000140
004525 00000154
004516 00000154
004423 00000140
004468 00000140
004532 00000154
004444 00000154
004531 00000154
004441 00000154
004577 00000154
004438 00000151
004518 00000151
004574 00000151
004513 00000155
004398 00000156
004588 00000153
004413 00000154
004403 00000154
004520 00000151
004512 00000140
004409 00000154
004430 00000151
004465 00000137
004482 00000154
004390 00000156
004546 00000140
004501 00000155
004404 00000154
004538 00000140
004487 00000154
004554 00000140
004471 00000154
004571 00000152
004406 00000154
004564 00000155
004499 00000155
004492 00000154
004558 00000140
004485 00000154
004536 00000140
004470 00000154
004541 00000140
004514 00000140
004551 00000140
004508 00000155
004559 00000140
004394 00000154
004542 00000140
004483 00000154
004479 00000154
004510 00000155
004410 00000154
004550 00000140
004490 00000154
004389 00000154
004502 00000155
004445 00000155
004562 00000155
004399 00000154
004494 00000154
004414 00000154
004533 00000140
004496 00000140
004395 00000151
004495 00000140
004462 00000155
004412 00000154
004407 00000151
004523 00000137
004535 00000137
004543 00000137
004575 00000153
004457 00000157
004528 00000153
004529 00000153
004515 00000153
004519 00000153
004455 00000157
004522 00000153
004472 00000151
004569 00000157
004433 00000153
004401 00000151
004417 00000139
004583 00000153
004526 00000153
004488 00000151
004434 00000153
004530 00000153
004552 00000153
004421 00000139
004425 00000154
004585 00000153
004580 00000153
004448 00000157
004452 00000157
004446 00000157
004565 00000157
004451 00000157
004436 00000153
004505 00000157
004461 00000157
004449 00000157
004497 00000157
004400 00000160
004566 00000157
004568 00000154
004570 00000157
004498 00000154
004573 00000157
004509 00000157
004453 00000157
004456 00000157
004504 00000157
004500 00000157
004511 00000157
004391 00000160
004454 00000154
004506 00000154
004572 00000157
004459 00000157
004434 00000156
004547 00000156
004543 00000156
004473 00000156
004399 00000156
004537 00000156
004477 00000138
004400 00000156
004444 00000152
004465 00000156
004496 00000147
004548 00000156
004372 00000159
004437 00000152
004566 00000152
004495 00000147
004489 00000141
004545 00000156
004552 00000156
004421 00000141
004461 00000141
004490 00000141
004525 00000147
004472 00000156
004412 00000141
004397 00000141
004450 00000147
004522 00000148
004425 00000147
004455 00000147
004459 00000147
004523 00000147
004530 00000147
004551 00000155
004475 00000156
004484 00000138
004439 00000147
004557 00000154
004387 00000141
004515 00000147
004494 00000147
004535 00000147
004558 00000147
004519 00000147
004449 00000147
004385 00000155
004454 00000147
004534 00000147
004395 00000141
004524 00000147
004417 00000141
004542 00000153
004423 00000141
004509 00000157
004415 00000141
004536 00000155
004532 00000147
004446 00000147
004497 00000147
004468 00000153
004393 00000141
004554 00000153
004485 00000141
004521 00000147
004375 00000141
004448 00000147
004392 00000141
004452 00000141
004493 00000147
004403 00000141
004411 00000141
004424 00000141
004481 00000141
004538 00000157
004483 00000141
004418 00000141
004384 00000146
004420 00000140
004469 00000155
004491 00000139
004391 00000140
004419 00000138
004456 00000144
004502 00000155
004386 00000146
004451 00000144
004526 00000146
004429 00000156
004371 00000146
004471 00000157
004427 00000146
004549 00000146
004369 00000141
004487 00000142
004402 00000155
004373 00000141
004533 00000146
004416 00000142
004520 00000146
004414 00000140
004381 00000148
004479 00000155
004544 00000157
004466 00000155
004370 00000156
004470 00000155
004406 00000155
004546 00000156
004376 00000140
004383 00000148
004458 00000146
004527 00000146
004453 00000146
004432 00000154
004528 00000146
004435 00000154
004447 00000147
004499 00000154
004476 00000157
004498 00000146
004504 00000154
004467 00000155
004561 00000154
004531 00000148
004463 00000155
004565 00000154
004541 00000155
004405 00000155
004492 00000146
004410 00000140
004457 00000146
004374 00000140
004430 00000154
004442 00000154
004445 00000156
004539 00000155
004486 00000140
004382 00000140
004505 00000156
004482 00000142
004390 00000140
004409 00000140
004553 00000158
004379 00000140
004540 00000158
004431 00000154
004413 00000140
004550 00000155
004380 00000155
004388 00000140
004408 00000140
004474 00000157
004433 00000156
004507 00000153
004426 00000143
004518 00000156
004460 00000149
004559 00000156
004480 00000146
004478 00000158
004529 00000146
004464 00000157
004462 00000157
004440 00000155
004398 00000139
004443 00000156
004438 00000156
004562 00000156
004404 00000157
004377 00000140
004513 00000156
004422 00000142
004394 00000142
004401 00000155
004378 00000142
004389 00000142
004501 00000156
004407 00000157
004508 00000156
004488 00000142
004396 00000142
004560 00000156
004516 00000156
004514 00000156
004556 00000153
004564 00000157
004567 00000156
004555 00000156
004568 00000155
004500 00000156
004517 00000156
004512 00000156
004436 00000156
004506 00000156
004510 00000153

Attachment: massive-intr.png
Description: PNG image

BYTE UNIX Benchmarks (Version 5.1.3)

System: KERNEL-128: GNU/Linux
OS: GNU/Linux -- 2.6.39-rc3ht-cpu-bandwidth-test+ -- #1 SMP PREEMPT Fri May 27 11:20:19 CST 2011
Machine: x86_64 (x86_64)
Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
CPU 0: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4787.8 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
CPU 1: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4786.6 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
CPU 2: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4786.6 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
CPU 3: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4786.6 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
14:27:45 up 42 min, 1 user, load average: 0.00, 0.04, 0.20; runlevel 3

------------------------------------------------------------------------
Benchmark Run: Mon May 30 2011 14:27:45 - 14:56:15
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables 23560040.2 lps (10.0 s, 7 samples)
Double-Precision Whetstone 2854.8 MWIPS (10.0 s, 7 samples)
Execl Throughput 240.6 lps (29.9 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks 32539.3 KBps (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks 8147.0 KBps (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks 124312.2 KBps (30.0 s, 2 samples)
Pipe Throughput 235002.6 lps (10.0 s, 7 samples)
Pipe-based Context Switching 21412.1 lps (10.0 s, 7 samples)
Process Creation 416.0 lps (30.0 s, 2 samples)
Shell Scripts (1 concurrent) 895.9 lpm (60.1 s, 2 samples)
Shell Scripts (8 concurrent) 352.1 lpm (60.2 s, 2 samples)
System Call Overhead 322619.9 lps (10.0 s, 7 samples)

System Benchmarks Index Values BASELINE RESULT INDEX
Dhrystone 2 using register variables 116700.0 23560040.2 2018.9
Double-Precision Whetstone 55.0 2854.8 519.1
Execl Throughput 43.0 240.6 56.0
File Copy 1024 bufsize 2000 maxblocks 3960.0 32539.3 82.2
File Copy 256 bufsize 500 maxblocks 1655.0 8147.0 49.2
File Copy 4096 bufsize 8000 maxblocks 5800.0 124312.2 214.3
Pipe Throughput 12440.0 235002.6 188.9
Pipe-based Context Switching 4000.0 21412.1 53.5
Process Creation 126.0 416.0 33.0
Shell Scripts (1 concurrent) 42.4 895.9 211.3
Shell Scripts (8 concurrent) 6.0 352.1 586.8
System Call Overhead 15000.0 322619.9 215.1
========
System Benchmarks Index Score 166.5

------------------------------------------------------------------------
Benchmark Run: Mon May 30 2011 14:56:15 - 15:24:49
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables 94432034.3 lps (10.0 s, 7 samples)
Double-Precision Whetstone 11421.1 MWIPS (10.0 s, 7 samples)
Execl Throughput 1787.6 lps (29.6 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks 25070.7 KBps (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks 6025.9 KBps (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks 70719.0 KBps (30.0 s, 2 samples)
Pipe Throughput 912685.3 lps (10.0 s, 7 samples)
Pipe-based Context Switching 168909.9 lps (10.0 s, 7 samples)
Process Creation 2796.7 lps (30.0 s, 2 samples)
Shell Scripts (1 concurrent) 3201.4 lpm (60.0 s, 2 samples)
Shell Scripts (8 concurrent) 431.3 lpm (60.3 s, 2 samples)
System Call Overhead 1233097.5 lps (10.0 s, 7 samples)

System Benchmarks Index Values BASELINE RESULT INDEX
Dhrystone 2 using register variables 116700.0 94432034.3 8091.9
Double-Precision Whetstone 55.0 11421.1 2076.6
Execl Throughput 43.0 1787.6 415.7
File Copy 1024 bufsize 2000 maxblocks 3960.0 25070.7 63.3
File Copy 256 bufsize 500 maxblocks 1655.0 6025.9 36.4
File Copy 4096 bufsize 8000 maxblocks 5800.0 70719.0 121.9
Pipe Throughput 12440.0 912685.3 733.7
Pipe-based Context Switching 4000.0 168909.9 422.3
Process Creation 126.0 2796.7 222.0
Shell Scripts (1 concurrent) 42.4 3201.4 755.0
Shell Scripts (8 concurrent) 6.0 431.3 718.9
System Call Overhead 15000.0 1233097.5 822.1
========
System Benchmarks Index Score 445.0

BYTE UNIX Benchmarks (Version 5.1.3)

System: KERNEL-128: GNU/Linux
OS: GNU/Linux -- 2.6.39-rc3ht-cpu-bandwidth-test-without-patch+ -- #2 SMP PREEMPT Fri May 27 16:00:22 CST 2011
Machine: x86_64 (x86_64)
Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
CPU 0: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4788.0 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
CPU 1: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4786.6 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
CPU 2: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4786.6 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
CPU 3: Intel(R) Xeon(R) CPU X3430 @ 2.40GHz (4786.6 bogomips)
Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
15:34:21 up 1 min, 1 user, load average: 0.90, 0.33, 0.12; runlevel 3

------------------------------------------------------------------------
Benchmark Run: Mon May 30 2011 15:34:21 - 16:02:43
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables 23570449.8 lps (10.0 s, 7 samples)
Double-Precision Whetstone 2856.0 MWIPS (10.0 s, 7 samples)
Execl Throughput 245.3 lps (29.9 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks 32605.9 KBps (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks 8211.5 KBps (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks 126138.2 KBps (30.0 s, 2 samples)
Pipe Throughput 231883.3 lps (10.0 s, 7 samples)
Pipe-based Context Switching 22245.2 lps (10.0 s, 7 samples)
Process Creation 421.0 lps (30.0 s, 2 samples)
Shell Scripts (1 concurrent) 714.7 lpm (60.1 s, 2 samples)
Shell Scripts (8 concurrent) 355.1 lpm (60.1 s, 2 samples)
System Call Overhead 316964.5 lps (10.0 s, 7 samples)

System Benchmarks Index Values BASELINE RESULT INDEX
Dhrystone 2 using register variables 116700.0 23570449.8 2019.7
Double-Precision Whetstone 55.0 2856.0 519.3
Execl Throughput 43.0 245.3 57.0
File Copy 1024 bufsize 2000 maxblocks 3960.0 32605.9 82.3
File Copy 256 bufsize 500 maxblocks 1655.0 8211.5 49.6
File Copy 4096 bufsize 8000 maxblocks 5800.0 126138.2 217.5
Pipe Throughput 12440.0 231883.3 186.4
Pipe-based Context Switching 4000.0 22245.2 55.6
Process Creation 126.0 421.0 33.4
Shell Scripts (1 concurrent) 42.4 714.7 168.6
Shell Scripts (8 concurrent) 6.0 355.1 591.9
System Call Overhead 15000.0 316964.5 211.3
========
System Benchmarks Index Score 164.3

------------------------------------------------------------------------
Benchmark Run: Mon May 30 2011 16:02:43 - 16:31:14
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables 94372189.3 lps (10.0 s, 7 samples)
Double-Precision Whetstone 11430.4 MWIPS (10.0 s, 7 samples)
Execl Throughput 1875.1 lps (29.9 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks 22718.2 KBps (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks 6067.2 KBps (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks 62203.8 KBps (30.0 s, 2 samples)
Pipe Throughput 884763.1 lps (10.0 s, 7 samples)
Pipe-based Context Switching 172161.4 lps (10.0 s, 7 samples)
Process Creation 2920.9 lps (30.0 s, 2 samples)
Shell Scripts (1 concurrent) 3230.3 lpm (60.0 s, 2 samples)
Shell Scripts (8 concurrent) 430.6 lpm (60.3 s, 2 samples)
System Call Overhead 1199897.3 lps (10.0 s, 7 samples)

System Benchmarks Index Values BASELINE RESULT INDEX
Dhrystone 2 using register variables 116700.0 94372189.3 8086.7
Double-Precision Whetstone 55.0 11430.4 2078.3
Execl Throughput 43.0 1875.1 436.1
File Copy 1024 bufsize 2000 maxblocks 3960.0 22718.2 57.4
File Copy 256 bufsize 500 maxblocks 1655.0 6067.2 36.7
File Copy 4096 bufsize 8000 maxblocks 5800.0 62203.8 107.2
Pipe Throughput 12440.0 884763.1 711.2
Pipe-based Context Switching 4000.0 172161.4 430.4
Process Creation 126.0 2920.9 231.8
Shell Scripts (1 concurrent) 42.4 3230.3 761.9
Shell Scripts (8 concurrent) 6.0 430.6 717.6
System Call Overhead 15000.0 1199897.3 799.9
========
System Benchmarks Index Score 439.0