性能测试用例模.docx

性能测试用例模测试用例模板 测试用例 (Test case) 用例名称 用例编号 重要程度 用例设计人 代码负责人 测试人 测试时间 English version Title Case ID Level Designer Developer Tester Time 测试场景描述 (Case scenario) 场景描述 子场景(可选) 子场景1 例如，返回10条记录 子场景2 例如，返回100条记录 测试流程 (Testing process) 描述被测试应用场景的商业流程，流程必须在实际测试中发挥良好的导航作用，使不熟悉该系统的使用者能够对商业流程有清晰的了解。 (被测的商业流程应该事先通过检测，以确保功能的顺利运行。应用程序代码在测试阶段应该被冻结) 1 2 3 测试条件和要求 (Requirements) 环境要求 硬件要求： WEB服务器 - 配置1.2 (详细配置信息见测试计划文档，或附录) 软件要求： 补丁要求： 网络要求： 性能基线和衡量指标 (Testing baseline & metrics) 前提 (测试结果有效的先决条件) 1. 例如：无内存泄漏；HTTP错误个数为0 2. 数据库数据要求 例如：流水表已有20万条记录 3. 并发连接数要求 4. 测试周期或测试次数 性能基线 1. 例如：每秒钟完成XXX笔交易 2. 3. 监视参数 (详情见附录) 1. 例如：Performance Monitor: Private Byte 2. 3. 性能计算方式 1. 例如：数据库交易表增加纪录数 / 总时间(秒) 2. 3. 测试数据和脚本 (Testing data, Scripts) 测试数据准备 包括登陆账号组，输入数据；可以事先保存在某个文本文件中 测试数据库 数据库、表、存储过程、视图、用户帐号、相关数据 测试脚本 根据测试工具编写相应脚本或编写手工测试脚本 for Example 1LBrowser 1. Navigate to the home page of the Online Shopping site. 2. Click “Help.” 3. Click “FAQ.” 4. Click “Shopping” on FAQ. 5. Click “Shopping/Our Products” on the main menu. 6. Click “Product Search.” 7. Click “Special Offers.” 8. Click “Store Finder.” 9. Click Central Scotland to view shop addresses. 10. Click “Edinburgh” to see details. 11. Click “After Sales.” 12. Click “Basket.” 13. Navigate to the home page of the Online Shopping site. 14. Click on Advert at bottom of page. 测试手段 (Testing instrument) 例如： 编写自动测试工具 或使用专用测试工具。 备注 (Remarks) 附录A 应用软件性能数据分类 4.1 应用软件性能数据概述 在企业级应用的负载测试过程中，测试工具通过部署一整套性能监视器，来收集和显示各个架构层次、服务器和组件上的性能数据，包括网络、操作系统、应用服务器、中间件、应用程序、.NET服务器、Web服务器和数据库服务器。在进行负载测试时，这些数据用来精确测量系统各个方面的性能，从而用户可以快速、简便地定位问题和瓶颈的来源。最终，这些数据用来生成各种文档和图表，并判断出应用程序的性能是否满足业务的需要。 4.2 应用软件常用性能数据描述 1. Number of Concurrent Users (NCU) 并发用户数 在指定时刻，系统观察到的并发用户连接数。 2. Request Per Second (RPS) 每秒处理请求数 指示服务器平均每秒钟能处理的用户事务请求数量。 3. Response Time 响应时间 指从客户发出一个事务请求到收到处理结果的最后一个字节的时间长度。 4. Time to First Byte (TTFB) 客户端收到响应的第一个字节的平均毫秒数。 5. Time to Last Byte (TTLB) 客户端收到响应的最后一个字节的平均毫秒数。 6. Think Time 思考时间 用户在发送下一个请求前花在浏览页面上的时间。 7. Hits per Second 每秒点击次数 8. Throughput 吞吐量 以kilobyte为单位，客户每秒接收的数据总量。 9. Pages per Second 每秒下载页数 每秒内从Web服务器上下载到客户端的Web页面数量。 10. User-define Data Point (supported by LoadRunner) 用户自定义性能指标 由LoadRunner支持的自定义性能指标，比如: Transaction Response Time, Transaction Per Second Passed, Failed。 11. %Processor Time:CPU平均利用率 12. %User Time:用户态CPU平均利用率 13. % Privileged Time:核心态CPU平均利用率 14. Processor Queue Length:处理器队列中的线程数 15. Context Switches per Second:每秒线程切换次数 16. Interrupts/Sec:每秒中断数 17. Page Faults / sec:每秒内存换页数 18. Memory, Available Bytes:平均剩余的可用内存 19. Private Bytes:进程分配内存数 20. Process, Handle Count:进程使用系统句柄数 21. Memory, Pool Paged Bytes:可交换到硬盘的系统物理内存byte数。 22. Memory, Pool Non-paged Bytes:不可交换到硬盘的系统物理内存byte数。 23. Network Interface, bytes total/sec:网络带宽利用率 24. Network Interface, Output Queue Length:网络适配器输出队列长度 25. Physical Disk, %Disk Time:物理磁盘利用率 26. Physical Disk, Avg Disk Queue Length:物理磁盘平均磁盘I/O队列长度 27. Physical Disk, Current Disk Queue Length:物理磁盘当前磁盘I/O队列长度 28. Physical Disk, Disk Read/Sec, Disk Write/Sec:物理磁盘每秒读/写操作次数 29. COM+ Authenticate (by LoadRunner):COM+ 调用级别验证成功频率 30. COM+ Authenticate Failed (by LoadRunner):COM+ 调用级别验证失败的频率 31. COM+ Activation (by LoadRunner):COM+ 应用激活频率 32. COM+ Failed (by LoadRunner):COM+ 应用关闭频率 33. COM+ Thread Start (by LoadRunner):STA的线程启动的比率 34. COM+ Thread Terminate (by LoadRunner):STA的线程中止的比率 35. Transaction Duration (by LoadRunner):COM+事务的平均周期 36. Transaction Start (by LoadRunner):COM+事务启动比率 37. Transaction Prepared (by LoadRunner):COM+事务进入准备阶段的比率 38. Transaction Aborted (by LoadRunner):COM+事务回滚的比率 39. Transaction Commited (by LoadRunner):COM+事务提交的比率 40. Object LifeTime(by LoadRunner):COM+组件平均生命期 41. Object Create (by LoadRunner):创建COM+组件实例的比率 42. Object Destroy (by LoadRunner):释放COM+组件实例的比率 43. Object Activate (by LoadRunner):COM+ JIT-actived对象激活的比率 44. Object Deactivate (by LoadRunner):COM+ JIT-actived对象失活的比率 45. Disable Commit (by LoadRunner):COM+对象处于DisableCommit状态的比率 46. Enable Commit (by LoadRunner):COM+对象处于Enable状态的比率 47. Set Complete (by LoadRunner):COM+对象处于SetComplete状态的比率 48. Set Abort (by LoadRunner)COM+对象处于SetAbort状态的比率 49. COM+ Method Duration (by LoadRunner):COM+方法调用平均持续时间 50. COM+ Method Frequency (by LoadRunner):COM+方法调用频率 51. COM+ Method Failed (by LoadRunner):COM+方法失败的频率 52. COM+ Method Exception (by LoadRunner):COM+方法抛出异常的频率 53. Active Server Page, Request per Second:ASP每秒执行请求数 54. Active Server Page, Request Queue:ASP请求队列长度 55. Active Server Page, Requests Execute Time:ASP平均请求执行时间 56. Active Server Page, Requests Wait Time:ASP平均请求等待时间 57. Active Server Page, Session Current:当前活动Session计数 58. .NET CLR Data, SqlClient, Current # Pooled Connection:当前被连接池缓存的数据库连接 59. .NET CLR Data, SqlClient, Current # Pooled and Non-pooled Connection 当前所有的数据库连接，缓存和未缓存的 60. .NET CLR Memory, Gen 0、1、2 heap size:.NET中0、1、2代虚拟堆的大小 61. .NET CLR Memory, # bytes in all Heaps:.NET中托管内存的总数 62. ASP.NET, Application Restarts:ASP.NET中应用重新启动的次数 63. ASP.NET, Work Process Restarts:ASP.NET中工作进程重新启动的次数 64. ASP.NET, Request Execution Time:ASP.NET平均请求执行时间毫秒数 65. ASP.NET, Request Wait Time:ASP.NET平均请求等待时间毫秒数 66. ASP.NET, Requests Queued:ASP.NET平均请求队列长度 67. ASP.NET Application, Requests/Sec:ASP.NET某特定应用每秒钟处理的请求数 68. ASP.NET Application, Requests Executing:ASP.NET某特定应用正在执行的请求数 69. ASP.NET Application Sessions Active:ASP.NET某特定应用中活动的Session数 70. Web Service, Get Requests per Second:HTTP的GET方法每秒请求数 71. Web Service, Post Requests per Second:HTTP的POST方法每秒请求数 72. Distributed Transaction Coordinator, Transactions/Sec 每秒的分布式事务数 73. Distributed Transaction Coordinator, Committed Transactions 提交的分布式事务总数 74. Distributed Transaction Coordinator, Aborted Transactions 回滚的分布式事务总数 75. Distributed Transaction Coordinator, Active Transactions 当前活动的分布式事务数 76. Distributed Transaction Coordinator, Response Time Average 分布式事务从开始到提交的平均时间间隔 77. SQL Server, Cache Manager, Cache Hit Ratio:SQL Server的缓存区命中率 78. SQL Server, Cache Manager, Cache Used Counts per Second SQL Server每秒内使用的缓存对象数 79. SQL Server, Locks, Exclusive/Shared & Users blocked SQL Server 每秒内用户由于表级锁被阻塞数 80. SQL Server, % Procedure Cache Used & % Procedure Cache Active SQL Server存储过程缓存使用率 81. SQL Server, Transaction/Sec:SQL Server每秒的事务数 82. SQL Server, General statistics, User Connections SQL Server 当前用户连接数 83. SQL Profiler, Audit Login/Logout SQL Profiler中跟踪用户登入/登出数 84. SQL Profiler, Stored Procedure, RPC Completed SQL Profiler中跟踪存储过程的调用 85. SQL Profiler, TSQL, Batch Completed:SQL Profiler中跟踪TSQL语句的调用 86. SQL Profiler, SQL Transaction:SQL Profiler 中跟踪事务的提交。 4.3 应用软件性能数据分类 企业应用程序可以根据系统架构分成以下类型 Client/Server 客户机/服务器架构l l 基于浏览器/Web服务器的三层架构 基于中间件应用服务器的三层架构l l 基于Web服务器和中间件的多层架构 以上架构都由客户机、Web服务器、中间层应用服务器、数据库服务器组成。通过针对不同层次的性能指标监测，可以分析出整体架构的性能指标和性能瓶颈。 1 数据库服务器的性能指标监测 l Processor, %Processor Time Processor, %User Timel Processor, %l Privileged Time Processor, Processor Queue Lengthl System, Contextl Switches per Second Memory, Page Faults/secl Memory, Availablel Bytes Memory, Pool Paged Bytesl Network Interface, bytes total/secl l Network Interface, Output Queue Length Physical Disk, %Disk Timel l Physical Disk, Current Disk Queue Length Physical Disk, Avg Disk Queuel Length Physical Disk, Disk Read/Sec, Disk Write/Secl SQL Server,l General statistics, User Connections SQL Server, Transaction/Secl SQLl Server, Cache Manager, Cache Hit Ratio SQL Server, Cache Manager, Cachel Used Counts per Second SQL Server, Locks, Exclusive/Sharedl & Users blocked SQL Server, % Procedure Cache Usedl & % Procedure Cache Active SQL Profiler, Audit Login/Logoutl SQL Profiler, Storedl Procedure, RPC Completed SQL Profiler, TSQL, Batch Completedl SQLl Profiler, SQL Transaction 2 Web服务器的性能指标监测 Processor, %Processorl Time Processor, %User Timel Processor, % Privileged Timel l Processor, Processor Queue Length System, Context Switches per Secondl l Process, Private Bytes Memory, Page Faults/secl Memory, Availablel Bytes Memory, Pool Paged Bytesl Network Interface, bytes total/secl l Network Interface, Output Queue Length Physical Disk, %Disk Timel l Physical Disk, Avg Disk Queue Length Number of Concurrent Users (NCU)l l Request Per Second (RPS) Response Timel Time to First Byte (TTFB)l l Time to Last Byte (TTLB) Think Timel Web Service, Get Requests perl Second Web Service, Post Requests per Secondl Active Server Page,l Request per Second Active Server Page, Request Queuel Active Serverl Page, Requests Execute Time Active Server Page, Requests Wait Timel l Active Server Page, Session Current 。 3 基于ASP.NET的Web服务器或Web Service服务器性能指标监测 Processor, %Processor Timel Processor, %User Timel l Processor, % Privileged Time Processor, Processor Queue Lengthl System,l Context Switches per Second Process, Private Bytesl Memory, Pagel Faults/sec Memory, Available Bytesl Memory, Pool Paged Bytesl l Network Interface, bytes total/sec Network Interface, Output Queuel Length Physical Disk, %Disk Timel Physical Disk, Avg Disk Queuel Length Number of Concurrent Users (NCU)l Request Per Second (RPS)l l Response Time Time to First Byte (TTFB)l Time to Last Byte (TTLB)l l Think Time Web Service, Get Requests per Secondl Web Service, Postl Requests per Second ASP.NET, Application Restartsl ASP.NET, Workl Process Restarts ASP.NET, Request Execution Timel ASP.NET, Request Waitl Time ASP.NET, Requests Queuedl ASP.NET Application, Requests/Secl l ASP.NET Application, Requests Executing ASP.NET Application Sessionsl Active 4 中间层应用服务器的性能指标监测 Processor, %Processor Timel Processor,l %User Time Processor, % Privileged Timel Processor, Processor Queuel Length System, Context Switches per Secondl Process, Private Bytesl l Memory, Page Faults/sec Memory, Available Bytesl Memory, Pool Pagedl Bytes Network Interface, bytes total/secl Network Interface, Outputl Queue Length Physical Disk, %Disk Timel Physical Disk, Avg Disk Queuel Length COM+ Authenticate (by LoadRunner)l COM+ Authenticate Failed (byl LoadRunner) COM+ Activation (by LoadRunner)l COM+ Failed (byl LoadRunner) COM+ Thread Start (by LoadRunner)l COM+ Thread Terminatel (by LoadRunner) Transaction Duration (by LoadRunner)l Transaction Startl (by LoadRunner) Transaction Prepared (by LoadRunner)l Transactionl Aborted (by LoadRunner) Transaction Commited (by LoadRunner)l Objectl LifeTime(by LoadRunner) Object Create (by LoadRunner)l Object Destroyl (by LoadRunner) Object Activate (by LoadRunner)l Object Deactivate (byl LoadRunner) Disable Commit (by LoadRunner)l Enable Commit (byl LoadRunner) Set Complete (by LoadRunner)l Set Abort (byl LoadRunner) COM+ Method Duration (by LoadRunner)l COM+ Method Frequencyl (by LoadRunner) COM+ Method Failed (by LoadRunner)l COM+ Methodl Exception (by LoadRunner) .NET CLR Data, SqlClient, Current # Pooledl Connection .NET CLR Data, SqlClient, Current # Pooled and Non-pooledl Connection .NET CLR Memory, Gen 0、1、2 heap sizel .NET CLR Memory, #l bytes in all Heaps Distributed Transaction Coordinator,l Transactions/Sec Distributed Transaction Coordinator, Committedl Transactions Distributed Transaction Coordinator, Aborted Transactionsl l Distributed Transaction Coordinator, Active Transactions Distributedl Transaction Coordinator, Response Time Average 5 客户机的性能指标监测 l Processor, %Processor Time Process, Private Bytesl Process, Handlel Counts Network Interface, bytes total/secl Network Interface, Outputl Queue Length Physical Disk, Avg Disk Queue Lengthl .NET CLR Memory, Genl 0、1、2 heap size .NET CLR Memory, # bytes in all Heapsl Number ofl Concurrent Users (NCU) Request Per Second (RPS)l Response Timel l Hits per Second Throughputl Pages per Secondl User-define Datal Point Time to First Byte (TTFB)l Time to Last Byte (TTLB)l Thinkl Time