Getting started with KITE is easy. Create your free KITE account and start testing from the cloud today in three easy steps:
KITE, the Keynote Internet Testing Environment, is a desktop-based test and measurement environment for recording and editing Web transactions and analyzing the performance of Web applications. In addition to testing from the desktop, KITE users may run test scripts from Keynote agents in 5 global cities on the Keynote network. Keynote customers also use KITE to record and maintain scripts which run on Keynote’s proactive monitoring services.
KITE provides consistent testing and measurement throughout the Web application lifecycle, and bridges the gap between Web developers, Quality Assurance (QA) and Web operations teams. With KITE, the exact same web application interactions may be played back and measured by multiple team members and from multiple locations.
KITE allows you to execute rapid performance analysis and validation directly on your desktop as well as from points on the public Internet.
KITE puts the same powerful Keynote agent technology used in Keynote’s flagship proactive scheduled monitoring services right on your desktop to run on demand. Use KITE to optimize your Web application before it goes into production, triage production issues as they occur, and validate changes or updates to your applications or content to ensure that performance continues to meet expectations.
KITE not only provides similar functions to a sniffer or HTTP analyzer, but also lets you record a Web transaction and save the transaction script file for future playback. KITE scripts can be modified if necessary, and KITE provides many advanced scripting tools to meet special requirements. KITE scripts can be played back on demand. Each time the script is run, KITE will measure and display performance metrics for all pages in your transaction. This provides a clear way to see the impact of variations in performance over time.
Another major advantage of KITE is that KITE scripts can be provisioned on Keynote Global Test and Measurement Network and run from five global cities for FREE. This gives user a critical outside-the-firewall perspective that helps pinpoint Web components to fine tune during the construction of the Web application.
You can use KITE to test the performance of your Web application right from your desktop. KITE is also a powerful performance prototyping environment providing detailed analysis of page download sequences and communication in repeatable scripts.
Designed to support dynamic Web interactions, including AJAX and other asynchronous communication, KITE displays page load time and file size of all page elements, browser event sequence, cached network times, scripts, HTTP header info, detailed error codes, and more.
One example of the performance tools included in KITE, the Event Log, is invaluable for investigating the exact download sequences within transactions, including the script steps performed by KITE, IE events and messages, and the HTTP requests passed to the server. It can be used to assess appropriate page completion events (to determine when the script should progress to the next step), and is also useful to examine page download performance.
When KITE scripts are uploaded to the Keynote Global Test and Measurement Network and run from five global cities, you get a critical outside-the-firewall perspective that helps pinpoint Web components to fine tune during the construction of the Web application.
The data from transaction measurements can be viewed from within KITE or within the MyKeynote portal.
1) Visualization within KITE:
First, when using KITE, the performance data from your recorded transaction is displayed directly in KITE every time your script is played back. You can see a list of network performance measurements as well as a waterfall view of every page in your transaction. For the greatest level of detail, choose the “Advanced” layout under Options, Layout, Restore:
Columns can be customized in any layout by right-clicking on any column header.
Several other powerful visualization tools are included in KITE, including the Performance Summary:
The Performance Summary provides valuable detail about the performance of each Action (step) in the transaction, including User Experience, Network Times, Errors, and overviews of cached and uncached page elements. Kite also provides information on the Request and response headers for each element.
Second, data can be visualized in the MyKeynote portal by running a 5-city free test (all KITE users) or uploading your transaction script to the Keynote Global Test and Measurement Network of monitoring agents for proactive monitoring (Keynote customers only).
Visualizing the results of 5-city free tests is covered in the FAQ topic, “How do I test from Keynote’s Global Network?”
Scripts uploaded to the Keynote Network of monitoring agents by Keynote customers are run and measured at specific intervals. This ongoing data collection is gathered and displayed in the MyKeynote Web interface for investigation, trending and analysis, and troubleshooting/diagnostic purposes.
MyKeynote provides many analytical tools to help you visualize and analyze your performance data. KITE users who are not yet Keynote customers can experience proactive monitoring and MyKeynote analytics by requesting a free two-week trial. Simply click the 24x7 Monitoring button at the top right of the Script and Performance ribbons in KITE:
The reports of the instant measurement taken from MyKeynote are available for 8 weeks. Up to 20 test results are stored.
YScripts are recorded in an XML format, and they can be optionally encoded to hide sensitive logins and URLs when transmitting files. For example, if you record a login to your Web application that includes a username and password, those values will be stored in the script file.
For security reasons, you may choose to encrypt files before uploading to MyKeynote or sending to others. This can be done very easily in KITE, by checking the Encrypt checkbox, then saving the script. The contents of the encrypted file would not be human-readable if opened in a text editor.
KITE makes a backup of your Internet Explorer cookies when launched and restores them upon exit of KITE. This means no more unintentional clearing of your favorite site preferences, “keep me logged in” settings, etc. Just remember to exit KITE before going to your favorite cookie enhanced site and all your personal settings will be intact.
The User Agent string in Internet Explorer will only reflect use of a Keynote agent (the presence of the KTXN string) while KITE is running. Upon exit of KITE, your original User Agent string will be restored. This avoids having your regular IE usage look like agent traffic.
PUSH TO START launches in one click the Run Test page on MyKeynote, your portal to Keynote’s Global Network. From here, you can run instant tests on single URLs as well as multi-page transactions
The results of your tests are displayed in your choice of graphically rich charts and graphs.
The dashboard at the top right of your results page lets you toggle between summary graphs types, display or publish detailed results, and even share your results via Digg, Twitter, Facebook, Windows Live and Yahoo! MyWeb.
Recording with KITE is very easy. Here is an overview:
1. To start recording a script, click the Record button in the upper left of the screen.
(You can choose which type of script to record, Real Browser/TxP or Emulated Browser/ApP – by default a Real Browser script is recorded.)
2. Enter the starting URL for your transaction and click OK.
Select Record as a new visitor if you do not want any cookies on your system to be available to the site you are starting at.
3. The Recording window opens with the Web site displayed. This window functions as your browser for navigating the Web transaction.
4. Navigate through the steps of your Web transaction using links and other controls visible on the Web page. You can also navigate to a new page, if necessary, by entering the new URL in the location field and clicking the green arrow button to the right of the location field.
As you navigate through the web site in the Recording window, you can see the steps of the script being added in the KITE Script Viewer.
Note: If there are steps in the Web transaction that cannot be completed within the browser panel, or which require special handling, you should record as much of the transaction as possible within the browser, and then edit the script after recording. See Editing Transaction Scripts in KITE help for information about how to edit the script after recording to accommodate special requirements.
5. When you are finished navigating through the steps of your Web transaction, click the Stop button at the upper left corner of the browser panel.
6. Save the script by clicking the Save button in KITE’s Script ribbon:
This script can now be played back for validation and to display performance information.
KITE supports both Keynote’s Real Browser (Transaction Perspective - TxP) and Emulated Browser (Application Perspective - ApP) Web monitoring services. The main differences between these two services are:
Real Browser (TxP) measurements use a real Internet Explorer browser to record and test Web applications. The TxP measurements provide complete and absolutely accurate end-user performance data executed in a full copy of IE7, which will render and execute every item on all pages in all cases.
Many Web pages and applications can be monitored in both the Real Browser (TxP) and Emulated Browser (ApP) services - with the only difference being in the fidelity of the user experience reported. Where site or application availability is the primary concern, or where the performance of a backend application (for example a login process) is the focus and the downloading of all items on a page is not relevant then the Emulated Service (ApP) is suitable for monitoring.
The Real Browser service, TxP, should be used to record Web application transactions where the user time (network time plus time to render in the browser) is important. TxP is also the appropriate choice where in-browser processing of dynamic content is central to the navigation scheme. TxP will provide full Internet Explorer or Firefox functionality, rendering every page and summoning any plug-ins that are required by the site.
Some Web pages and applications can only be monitored using the Real Browser (TxP) service because they rely on asynchronous communications (AJAX), requiring logic to be executed in the browser to support the user interface. An example might be a transaction where the browser must render complex AJAX content in order to reveal the login fields
One of the primary benefits of testing Web applications from the Keynote network is that you gain visibility into the user experience that is occurring outside your firewall. The true user experience involves your application communicating over the Internet, across multiple carriers and geographies, and potentially out to the ‘last mile’ of network infrastructure to reach your user. The distributed architecture of Keynote agents, all measuring your transaction at specific intervals, will gather enough data to diagnose any network and transmission problems as well as internal Web architecture problems that your users may experience. In short, you need to monitor the performance of your Web applications from out on the Internet, because that is exactly where your end-users are.
Typically you should record a transaction that is a ‘critical path’ through your Web application. You should include popular paths and pages in your site that are important to the success of your business. Choose transactions that you want monitored and captured for diagnosis in case of critical failure. Examples would be a login process, database query, shopping check-out, or other transaction containing content you wish to monitor. For example, if your typical customer uses your site to search for a particular item, fill the cart and then proceed to make a payment, then these three steps will constitute the critical path you should monitor on a continuous basis.
Note that playing back a recorded test script has the same effects as performing the actions it contains. Therefore, any financial transactions may need to be ended before the transaction is executed to avoid incurring costs.
After you have created and validated (played back) your transaction within KITE, save the script locally. Next, click the Instant Test button on the right side of the Script or Performance ribbons in KITE:
A browser window will open to the Test tab in MyKeynote:
Click the Test Script tab and the “Upload Script” button to browse to your saved script and upload it:
Finally, follow the on-screen instructions to verify the image and launch your test with the Run Instant Test button, Note: The instructions in this topic apply to the free 5-City Test. To learn about uploading scripts for a 2-week trial of 24x7 monitoring, see the FAQ topic, “Q. How can I expand my test and measurement beyond the 5 FREE cities?”. To learn about uploading scripts for 24x7 monitoring as a Keynote Customer, visit Keynote Support Central and consult the FAQ’s there.
Yes. Using Transaction Perspective (TxP), KITE is equipped to handle the most complex Web page content because it uses a real browser to record the transaction. TxP provides complete and absolutely accurate data, executed in a full copy of IE7, which will render and execute every item on all pages in all cases. Some Web pages and applications can only be monitored using TxP because they rely on asynchronous communications requiring logic to be executed in the browser to support the user interface. TxP is also the right choice for recording and monitoring Flash or Silverlight, because TxP’s Screen Sensing Technology™ can record and play back interaction within the Flash or Silverlight application.
Web pages containing forms and secure login can also be handled by the emulated browser (ApP).
Our Internet infrastructure consists of three key primary components:
1. Measurement and data collection infrastructure
2. Operations and data center
3. Reporting and analysis tools
Our globally distributed measurement agents are Windows-based computers that run either real IE browsers or Keynote proprietary software to replicate the experience of a user accessing Web sites through a standard Web browser. Our measurement-computer software can perform thousands of download measurements concurrently without distorting or affecting the integrity of any single measurement. Keynote agent computers are co-located at the data center facilities of major telecommunication and Internet access providers. These providers are selected to be statistically representative of Internet users.
Keynote agents access a Web site to download Web pages and execute multi-page transactions, while taking measurements of every component in the process. The computers take measurements continually throughout the day, at specified intervals, depending on the customer’s requirements and subscription service level.
We currently deploy more than 2,400 measurement computers and mobile devices in over 240 geographic locations around the world. We continually upgrade and balance our network capacity to meet the needs of our customers.
Our operations centers, located in San Mateo, California, and Plano, Texas, can support large numbers of measurement computers and store, analyze and manage large amounts of data from these computers. Our measurement computers receive instructions from, and return collected data to, our operations center. The data are stored in large databases that incorporate a proprietary transaction-processing system that is highly efficient in storing and delivering measurement data with fast response times.
We also employ proprietary, high-performance application server computers that manage the collection of measurement data, the insertion of the data into our databases and the dissemination of this data to our customers in a variety of forms and delivery methods.
Our operations centers take over 200 million Internet measurements daily, all collected in an Oracle database that is over 3TB in size. This is the largest performance data center in the world.
Keynote has a set of redundant connections (AT&T, Verizon, even satellite backup) to ensure that the data gets to us, no matter what. We have backup generators that can produce electricity even if the local grid cannot, and most importantly, we have a fail-over mechanism to our operations center in Plano, Texas where all of the data is replicated continuously
If your pages contain data from a variety of sources, e.g., CDN-served page elements like ads or images, you want to see the response time for your content separately from the third-party content.
The new Filters and Virtual Pages features let you focus on the page elements that matter and eliminate the ones that do not.
Each of these Virtual Pages is then sent to your MyKeynote portal as a separate page in your transaction. This way you can use MyKeynote's powerful alarms, trending graphs and reporting tools on just the data that matter most to you.
You can filter by defining one or more Match Page Elements statements. These statements can contain simple strings such as the domain portion of a URL (http://www.mysite.com) or highly flexible regular expression formulas.
When developing scripts, or triaging issues, you may want to quickly share or document the details of a script. With the new Script Report feature you are just one click away from a well-formatted report in KITE or MyKeynote. Once displayed, you can easily copy and paste the entire report into an email or print it and hand to a colleague.
KITE 's recording window has an Address Bar where you can enter a new URL in the middle of a transaction. This often-requested direct navigation feature gives you greater control and flexibility in the recording window while creating familiar "Navigate to" commands in the scripting window.
KITE allows great flexibility in the choice of columns to display in the Performance tab. Unselect Fit Columns to Window Width and no longer be constrained by the current window's width. A scroll-bar appears, letting you explore any number of columns.
Want to take a quick look at all captured data for an object on your page without adding all the columns to KITE's display? Just right-click and choose View Selected Row's Data to get a pop-up window with all the details.
To successfully install KITE, please make sure that you are running Windows XP or Windows Vista with the latest service packs installed. For further troubleshooting information please use the Community link at http://kite.keynote.com/community. If you do not find a similar issue along with a solution already posted there by using the Search feature, log in with the same username and password used for KITE and post a message, quoting any error messages or symptoms.
To uninstall KITE, you may use the Add/Remove Programs wizard located in the Windows Control Panel. For further troubleshooting information please use the Community link at http://kite.keynote.com/community. If you do not find a similar issue along with a solution already posted there by using the Search feature, log in with the same username and password used for KITE and post a message, quoting any error messages or symptoms.
To submit feature enhancements please find the Product Feedback tab at http://kite.keynote.com/product-feedback.php. We would love to hear from you and learn how we can make this tool even better.
To capture data needed for monitoring and troubleshooting we have made it easy for you to create deep diagnostic probes with the Add Automated Custom Components feature. You can add calculated or custom-extracted data to your monitoring results easily.
To quickly determine what exactly happens during each step of your script the Page Snapshot Pane shows what was displayed in the browser as the script ran. Each step is clearly labeled at the top of the Page Snapshot Pane. Navigation arrows let you step through the script one action at a time, or simply click on an action name in the Script Viewer to display that action's snapshot.
To speed up your mean time to repair (MTTR) you can now view your Transaction Performance Details grouped by multiple columns at the same time. Think of it like a Pivot Table in Excel or arranging your email "by conversation" in Outlook. The new Group-By Area feature is a grey pallete just above the column headers where you can drag and drop multiple columns in and out, and instantly see your data reorganized.
A: There are two types of mouse clicks: one through HTML DOM (simulated) and one where you actually move the mouse pointer.
The outcome in the second case, for some sites with AJAX, is that multiple mouse events get triggered – in/out of element, hover over element, and the actual click. The first approach only generates a mouse click.
KITE is configured to display the Script Repository by default at startup, performing a search for scripts, which can slow the initial performance of KITE when you have more than a few scripts. It is advisable to disable the initial display of the Script Repository when you have more than a few scripts; note that it is possible to re-display the Script Repository at any time using menu options in KITE.
To disable the Script Repository on startup:
Select the Options tab.
Select All Settings > Settings.
Under UI, deselect Start Local Scripts View.
Validation can be used to ensure that a page has loaded completely or correctly, by searching for a specific string of text in a page. Validation can use “required ” text or “error” text. If a required text value is missing, or error text is present, an error is reported.
Validation is easily added to a script by right-clicking an Action name, and selecting Add Validation.
Then right-click the validation entry and select either Add Required Text or Add Error Text.
Under Script Properties, enter the string of text you wish to validate, then save and play your script.
Use case: Validation of required text is useful when you want to ensure that a specific piece of content has loaded or been parsed into a page. An example would be a title word or text from an ad served by a CDN to monitor the success of the ad in your page.
Burst mode lets you run test scripts back to back in quick succession. While this is not a load or “stress” test, it does provides valuable insights into the effect of performance when the Web application is run back to back from the desktop. KITE accounts that are not associated with Keynote Customer accounts can run a maximum of 2 bursts at a time. KITE accounts associated with Keynote customer accounts can run a maximum of 10 bursts at a time.
KITE sends your login information and usage statistics to the authentication server. This is used to personalize the KITE start page.
You must register for a free account in order to use KITE. The registration process is simple and it provides you with unlimited performance testing using KITE from the Desktop and from the 5 global locations.
Since Keynote is a SAAS company, we need to proactively plan for the resources. Registration helps us plan for the capacity at these global locations ahead of time.
When you click the Help link in the upper-right corner of KITE, or press F1, a help page appears describing the pane or dialog that is currently active. The help system has a contents panel that shows all the help topics. In addition, you can use the search feature in the help system to find specific words.
Note: It is a good idea to also check the online version of help, as we are able to update it more frequently. You’ll find a link at the top and bottom of every topic in the help file that is similar to the one below. Click it to jump to the web version of that topic:
KITE comes with three preset workspaces: Advanced, Default, and Simple. You can also save your preferred workspace by selecting Options > Layout > Save... It is easy to store variations of the preset workspaces: Start by choosing Layout, Restore, Advanced (for example) and then make your changes by closing or moving a tab from one pane to another. Finally, choose Layout, Save… and give the layout a new unique name.
Windows XP, Windows Vista
Microsoft Internet Explorer (IE) 6 and 7 (for scripts to be uploaded to the 5-City test or scheduled monitoring on the Keynote Network. Internet Explorer 6, 7 and 8 for scripts that will be run only on the desktop.
Windows service pack prerequisites for IE
MSXML 4.1 SP 1 or Later
Flash - 126.96.36.199 or Later
Computer/Processor (Recommended): Dual 1.8 GHz Pentium (P4) or better
Memory RAM - 512 MB (1 GB and above for better performance)
Currently we only support KITE on the Windows platform, and we do not plan to support other platforms.
You may use other platforms (i.e. Linux, OSX, Unix) to run 5-City URL tests or upload existing KITE scripts to run 5-City scripted tests by logging into http://my.keynote.com with your KITE account and choosing the Test tab.
You can record detailed Flash & Silverlight interactions like mouse-clicks, hover-overs, text entry and system-key navigation such as tab, enter or function keys using our Screen Sensing Technology™. When you play your script, the Flash or Silverlight application is actually exercised, not just downloaded. KITE captures all network activity generated as the Flash or Silverlight application responds to the scripted user input allowing you to quickly determine, which interaction contributes to a performance slowdown.