Friday, 29 August 2008

Neeraj Nathani Smart Bridge Trading Solutions Data warehouse


Data warehouse

In computing, a data warehouse or enterprise data warehouse (DW, DWH, or EDW) is a database used for reporting and data analysis. It is a central repository of data which is created by integrating data from one or more disparate sources. Data warehouses store current as well as historical data and are used for creating trending reports for senior management reporting such as annual and quarterly comparisons.
The data stored in the warehouse are uploaded from the operational systems (such as marketing, sales etc., shown in the figure to the right). The data may pass through an operational data store for additional operations before they are used in the DW for reporting.
The typical ETL-based data warehouse uses staging, data integration, and access layers to house its key functions. The staging layer or staging database stores raw data extracted from each of the disparate source data systems. The integration layer integrates the disparate data sets by transforming the data from the staging layer often storing this transformed data in an operational data store (ODS) database. The integrated data are then moved to yet another database, often called the data warehouse database, where the data is arranged into hierarchical groups often called dimensions and into facts and aggregate facts. The combination of facts and dimensions is sometimes called a star schema. The access layer helps users retrieve data.[1]
A data warehouse constructed from an integrated data source systems does not require ETL, staging databases, or operational data store databases. The integrated data source systems may be considered to be a part of a distributed operational data store layer. Data federation methods or data virtualization methods may be used to access the distributed integrated source data systems to consolidate and aggregate data directly into the data warehouse database tables. Unlike the ETL-based data warehouse, the integrated source data systems and the data warehouse are all integrated since there is no transformation of dimensional or reference data. This integrated data warehouse architecture supports the drill down from the aggregate data of the data warehouse to the transactional data of the integrated source data systems.
Data warehouses can be subdivided into data marts. Data marts store subsets of data from a warehouse.
This definition of the data warehouse focuses on data storage. The main source of the data is cleaned, transformed, cataloged and made available for use by managers and other business professionals for data mining, online analytical processing, market research and decision support (Marakas & O'Brien 2009). However, the means to retrieve and analyze data, to extract, transform and load data, and to manage the data dictionary are also considered essential components of a data warehousing system. Many references to data warehousing use this broader context. Thus, an expanded definition for data warehousing includes business intelligence tools, tools to extract, transform and load data into the repository, and tools to manage and retrieve metadata.

Benefits of a data warehouse

A data warehouse maintains a copy of information from the source transaction systems. This architectural complexity provides the opportunity to:
  • Congregates data from multiple sources into a single database so a single query engine can be used to present data.
  • Mitigates the problem of database isolation level lock contention in transaction processing systems caused by attempts to run large, long running, analysis queries in transaction processing databases.
  • Maintain data history, even if the source transaction systems do not.
  • Integrate data from multiple source systems, enabling a central view across the enterprise. This benefit is always valuable, but particularly so when the organization has grown by merger.
  • Improve data quality, by providing consistent codes and descriptions, flagging or even fixing bad data.
  • Present the organization's information consistently.
  • Provide a single common data model for all data of interest regardless of the data's source.
  • Restructure the data so that it makes sense to the business users.
  • Restructure the data so that it delivers excellent query performance, even for complex analytic queries, without impacting the operational systems.
  • Add value to operational business applications, notably customer relationship management (CRM) systems.

Generic data warehouse environment

The environment for data warehouses and marts includes the following:
  • Source systems that provide data to the warehouse or mart;
  • Data integration technology and processes that are needed to prepare the data for use;
  • Different architectures for storing data in an organization's data warehouse or data marts;
  • Different tools and applications for the variety of users;
  • Metadata, data quality, and governance processes must be in place to ensure that the warehouse or mart meets its purposes.
In regards to source systems listed above, Rainer states, “A common source for the data in data warehouses is the company’s operational databases, which can be relational databases” (130).
Regarding data integration, Rainer states, “It is necessary to extract data from source systems, transform them, and load them into a data mart or warehouse” (131).
Rainer discusses storing data in an organization’s data warehouse or data marts. “There are a variety of possible architectures to store decision-support data” (131).
Metadata are data about data. “IT personnel need information about data sources; database, table, and column names; refresh schedules; and data usage measures (133).
Today, the most successful companies are those that can respond quickly and flexibly to market changes and opportunities. A key to this response is the effective and efficient use of data and information by analysts and managers (Rainer, 127). A “data warehouse” is a repository of historical data that are organized by subject to support decision makers in the organization (128). Once data are stored in a data mart or warehouse, they can be accessed.

Facts

A fact is a value or measurement, which represents a fact about the managed entity or system.
Facts as reported by the reporting entity are said to be at raw level.
E.g. if a BTS received 1,000 requests for traffic channel allocation, it allocates for 820 and rejects the remaining then it would report 3 facts or measurements to a management system:
  • tch_req_total = 1000
  • tch_req_success = 820
  • tch_req_fail = 180
Facts at raw level are further aggregated to higher levels in various dimensions to extract more service or business-relevant information out of it. These are called aggregates or summaries or aggregated facts.
E.g. if there are 3 BTSs in a city, then facts above can be aggregated from BTS to city level in network dimension. E.g.

[edit] Dimensional vs. normalized approach for storage of data

There are two leading approaches to storing data in a data warehouse — the dimensional approach and the normalized approach.
The dimensional approach, whose supporters are referred to as “Kimballites”, believe in Ralph Kimball’s approach in which it is stated that the data warehouse should be modeled using a Dimensional Model/star schema. The normalized approach, also called the 3NF model, whose supporters are referred to as “Inmonites”, believe in Bill Inmon's approach in which it is stated that the data warehouse should be modeled using an E-R model/normalized model.
In a dimensional approach, transaction data are partitioned into "facts", which are generally numeric transaction data, and "dimensions", which are the reference information that gives context to the facts. For example, a sales transaction can be broken up into facts such as the number of products ordered and the price paid for the products, and into dimensions such as order date, customer name, product number, order ship-to and bill-to locations, and salesperson responsible for receiving the order.
A key advantage of a dimensional approach is that the data warehouse is easier for the user to understand and to use. Also, the retrieval of data from the data warehouse tends to operate very quickly. Dimensional structures are easy to understand for business users, because the structure is divided into measurements/facts and context/dimensions. Facts are related to the organization’s business processes and operational system whereas the dimensions surrounding them contain context about the measurement (Kimball, Ralph 2008).
The main disadvantages of the dimensional approach are:
  1. In order to maintain the integrity of facts and dimensions, loading the data warehouse with data from different operational systems is complicated, and
  2. It is difficult to modify the data warehouse structure if the organization adopting the dimensional approach changes the way in which it does business.
In the normalized approach, the data in the data warehouse are stored following, to a degree, database normalization rules. Tables are grouped together by subject areas that reflect general data categories (e.g., data on customers, products, finance, etc.). The normalized structure divides data into entities, which creates several tables in a relational database. When applied in large enterprises the result is dozens of tables that are linked together by a web of joins. Furthermore, each of the created entities is converted into separate physical tables when the database is implemented (Kimball, Ralph 2008). The main advantage of this approach is that it is straightforward to add information into the database. A disadvantage of this approach is that, because of the number of tables involved, it can be difficult for users both to:
  1. join data from different sources into meaningful information and then
  2. access the information without a precise understanding of the sources of data and of the data structure of the data warehouse.
It should be noted that both normalized and dimensional models can be represented in entity-relationship diagrams as both contain joined relational tables. The difference between the two models is the degree of normalization.
These approaches are not mutually exclusive, and there are other approaches. Dimensional approaches can involve normalizing data to a degree (Kimball, Ralph 2008).
In Information-Driven Business (Wiley 2010),[6] Robert Hillard proposes an approach to comparing the two approaches based on the information needs of the business problem. The technique shows that normalized models hold far more information than their dimensional equivalents (even when the same fields are used in both models) but this extra information comes at the cost of usability. The technique measures information quantity in terms of Information Entropy and usability in terms of the Small Worlds data transformation measure.[7]


Source: Wikipedia.

Thursday, 14 August 2008

Smart bridge Picking Winners In Big Data Neeraj Nathani Smart bridge



Picking Winners In Big Data
Big data solutions are picking up speed in the IT industry. There’s a Cambrian explosion of interesting start-ups, and all the database and business intelligence incumbents have moved to create big data offerings, or rebrand into the new universe.
The key to seeing the value of big data is understanding that it’s a business problem, not a matter of picking the right tools and waiting for the magic to happen. That said, technology choices still need to be made in an increasingly crowded and confused market.
The biggest question for anybody wanting to invest or adopt technology in this area is how to pick the winner? Glancing through marketing materials will do little to help you: everybody claims relevance to big data.
As I am often asked my opinion about big data companies, I thought I’d share some of the principles I use to help me think about the industry.
Where’s the value?
We need to understand where the actual value is in the data world. For the most part, this value doesn’t lie purely in the software. Over the past decade we have seen a rising tide of commoditization of the software stack: from operating system, to relational databases, to Hadoop itself. In fact, without this, we wouldn’t have the big data revolution as we know it.
As Hadoop has become a de facto standard, so has the notion of building on top of it with open source. There is some advantage in software innovation, but it is momentary. Once something is known to be possible, there are enough smart programmers out there that reproducing it becomes straightforward. (Because of this, I gloomily predict no shortage of patent battles in the not-too-distant future.)
Despite the flux in the software world, two things about big data remain constant: the need for compute and storage, and data itself. It’s ultimately to ownership of one or both of these factors that IT industry value will gravitate.
Compute and storage
The ever growing need for computing power and storage bodes well for companies providing the basics. These fall into two categories: hardware manufacturers, and cloud infrastructure providers. Not that these two markets are immune to their own fluctuations, thanks to standardization and commoditization, but fundamentally, getting paid for use of metal is the name of the game.
In this respect, it’s not too much of a mystery why storage company EMC has plowed so early and so deep into the big data world. Neither is it hard to see the reasoning behind Intel creating its own optimized Hadoop distribution.
Data
Value resting in data is the more subtle of the two axes of big data success.
Big data is ultimately about the smart use of data to drive a business. There are two kinds of data: data about your business, and data external to your business that you can create value from.
It’s easy to see who might get success from the latter, external data. We can expect that massive data owners such as Google, Facebook, Thomson Reuters, Bloomberg will experience ongoing success for as long as they are able to create product from their data.
Who owns your data, though? The obvious answer, you, isn’t the only answer. In fact, your data is locked up inside the platform choices you make, at both the hardware and software level. If your systems are based on Oracle, Microsoft, you are very unlikely to move in a hurry. Data likes to stay where it is, and tends to attract more data as you build systems around it. Production systems are expensive to replace.

So, the vendors of your software platforms of choice also get long term value from your data. For this reason, it’s hard to bet against existing enterprise application platform incumbents in the big data world. Big data, for most of today’s organizations, is an additive phenomenon, not a challenge to the core of IT.
We’ll see more large platforms ensuring nobody needs to move away. Examples include SAP adding HANA, in order to enable their existing customers for big data, or Amazon Web Services’ addition of their data warehouse Redshift, to ensure that the entire data needs of a company can be met on their platform.
Finally, it would be lunacy to bet against either Oracle, who have been portentously quiet in the big data world over the last year, or Microsoft, who in Excel have the world’s most popular data manipulation environment.
It is all business as usual?
I’m not saying there is no new opportunity in the big data industry. What I am saying is that, as an additive technology, big data is unlikely to enable anybody to challenge Oracle or Microsoft for the throne.
There will be change, though, and it will bring both winners and losers.
The area of value we haven’t yet looked at yet is the point where data interacts with the actual mechanism of a business. That’s where it transfers value to you and enables you to leverage data to get ahead. This breaks down into several areas of opportunity for big data innovators.
  • Domain specific: tools that enable the manipulation and exploitation of data in a way that’s specific to a business segment. We see initial evidence of this market opportunity in the evolution of web and customer analytics products.
  • Machine learning: more data means more to understand, and the only way an organization can realistically do this is with the aid of computers. Machine learning helps automate many parts of the data wrangling process. Furthermore, cross-company data sharing can significantly boost the effectiveness of machine-learning, creating the opportunity for companies gaining early market share. A recent example of this is Sift Science, a fraud detection application.
  • Tools for exploration: human interaction with data is a requirement that’s hard to abstract away. Tableau has a head start in this market for big data, filling the role of “Microsoft Office for Data”, but the field is ripe for new innovation, especially with the increasing power of graphical capabilities and new device formats.
  • Data agility: speed-to-decision is a critical factor in business competitiveness. Any solution that removes laborious steps has an advantage: a particularly problematic area here is data integration, the loading of both internal and external data sources ready for analytics. Most of today’s big data solutions are frankensteined combinations of layers: there’s a great opportunity for vertically integrated solutions that removes needless impedance to data manipulation.
Move up http://i.forbesimg.com t Move down
Areas of risk
What are those riskier big data options? If a solution isn’t scoring high in the categories above, it’s not likely to be around for the long run.
The biggest risk is with solutions that address only a single horizontal part of the data architecture. Time is against companies in this game. By selling just part of a complete solution, they’re working against the rising tide of commoditization. Customers will demand standardization (e.g. Hadoop compatibility) in order to feel safe adopting such solutions, but that prevents the lock-in that will protect that business. It’s not Oracle’s relational database that cements their position: it’s their vertical position up and down the application stack.
Therefore, it’s not surprising to see the pure Hadoop distribution companies making partnerships, and branching out into other vertical layers. In the long term, it’s a tough road they’ve chosen.
One company working actively to solve this problem is DataStax, who have pivoted from being seen as the corporate backer for the Cassandra NoSQL database—a risky horizontal play—to selling an integrated stack of Cassandra, Hadoop and Solr, intended as a complete platform for building enterprise applications. They’re going after some of the platform business: being involved in the actual use of data to drive business value.
For some start-ups, not having long term big data viability might be just fine as a strategy. As the bigger enterprise companies lumber into the arena, they’ll prove handy acquisitions. But given the crowded space and progressive commoditization, this isn’t a certain future. And certainly for their customers, the risks are growing.
More controversially, another area at risk is that of traditional ETL. Or in its broader sense, data integration. This is a hard, hard, problem. It’s not easy to integrate data retrospectively, and it’s not all certain that the integration players from the data warehouse world will be able to translate that success into the big data world. Many early adopters of Hadoop were motivated by the fact that existing ETL solutions couldn’t meet their needs.
In the long term, data integration is likely to be best served by entire new architectures that don’t try to separate and tame the data in the first place. It’s a lot easier to build truly integrated data infrastructure as greenfield.
For those who crack the integration problem, the potential rewards are high. But so is the risk.
Conclusion
In the long term, the additive nature of big data, combined with inertia, makes it a safe bet that current enterprise IT incumbents will continue their reign, as long as they move to embrace big data in their architectures.
There is plenty of opportunity though, especially in greenfield and cloud scenarios. Expect to see increasing returns for those who provide integrated solutions and do a good job of equipping human decision makers.
There’s long term value in metal, and value in data. About everything else, it’s worth thinking carefully.

Source: Wikipedia./Forbes

Tuesday, 29 July 2008

nEERAJ nATHANI Trade Promotion Management (TPM)


Trade Promotion Management (TPM)

Trade Promotion Management typically refers to one or more software applications that assist companies in managing their complex trade promotion activity. Trade Promotion Management is a challenge faced by most CPG/FMCG companies around the globe. Consumer goods companies spend substantial amounts of time and money—14 percent of revenue, according to an AMR Research study—on promotions with retailers designed to boost revenue or increase/protect market share (or both).[1] Key Account Managers and Category/Brand Managers are responsible for developing and implementing a promotional program that delivers the maximum return on investment and manages the trade off between incremental volume and maintenance of a reasonable level of trade spend.[2]
Gartner
Gartner believes that technologies related to managing trade promotions have never been more relevant, as the average revenue expended by manufacturers for promotions now exceeds 20%. More and more companies are leaving spreadsheets for automated technologies, while others are adding promotion optimization capabilities

Key functions

  • sales forecasting
  • Promotion planning and budgeting
  • Predictive modeling/optimization
  • Promotion execution and monitoring
  • Settlement
  • Post event analysis

Business problems addressed

Historically, there have been many solutions to trade promotion management. Commonly, companies use their accounting systems or spreadsheets, but as the complexity of trade increases software solutions have been developed and implemented to fill the needs of companies in various industries including consumer goods, food manufacturing, food service and others.

 Lack of accurate and timely information to support trade promotion decision-making

Trade promotion decisions are often rushed and based on sub-par data. While sales and marketing managers are surrounded by promotion information, questions on retail commitment and product forecast accuracy can hinder the process. Multiple data sources and conflicting needs from various departments further complicate the issue.

Inability to plan promotions based on analytics

Historical trade promotion data should be analyzed in order to continually improve trade promotions. If a company does not utilize processes and systems that measure trade promotion performance, future trade promotion executions could be less effective than if they’d been planned using past analytical information.

Ineffective organization and partner integration

Lack of integration both internally and with external partners can hinder trade promotion success. Key elements of organizational integration include standardized metrics, regular information sharing, cross-functional department collaboration, and collaborative processes4. Integration with retail partners is important to executing promotions successfully, as well as maintain strong relationships with retailers over time.

Lack of appropriate Key Performance Indicators (KPI)

KPIs tell manufacturers and retailers how trade promotions performed relative to their pre-determined objectives. A lack of understanding on what trade promotion data to measure and how to measure performance can hinder the overall process. Manufacturers and retailers will not know what made a promotion effective or ineffective unless they have predetermined data points to measure and analyze.
Lack of control and the ability to accurately monitor the effectiveness and efficiency of Trade Promotions is the key area of concern. Many companies still utilise vast arrays of fragmented spreadsheet style reports to manage their TPM activities.
The complexities of the typical Trade Promotion Management process can be appreciated in this diagram which is based on just one individual retailer account.
Not all promotions are created equal and there are many ways of looking at a promotion and evaluating the effective and efficient use of trade funds. The characteristics of your product portfolio eg beer, toilet paper, toothpaste and yoghurt will impact on the performance of your trade promotion even if the same promotional strategy is used.
For example: with the same size and display location, toilet tissue wipes up the competition with an 82% display driven lift, with yoghurt a distant second at 28%, beer at 15% and toothbrushes at 14%.
(Source: Nielsenwire “Six Trade Promotion Tips: Why Less Can be More”)
Why Promote?
Promotions are undertaken with the intention of driving an increase in consumer sales. This may be instigated as the Brand Manager has a target/KPI to achieve and the promotion is designed to close the gap between the baseline sales and the target. Generally the manufacturer will sell their products to retailers at a discount to help fund the promotion. This discounting is of no benefit if there are no additional sales as a result of the promotion.
Promax delivers key information that helps Brand Managers answer questions, such as:
  • What to promote?
  • How often to promote?
  • Timing – when to promote?
  • Duration – how long to promote?
  • Promotional level – how much should I offer?
  • Product selection – which bundle of products to select?
  • Are the trade deals aligned with the Brand positioning?
  • What is the level of sales lift during the promotional period?
  • Has the promotion created a long-term impact on base-line consumer sales?
  • What happens if I change the frequency of my promotions?
  • Do my promotions clash amongst various retailers?
  • Are specific promotions cannibalising sales of other products in my portfolio and/or competitor products?
  • What is the optimum scenario in terms of volume and profitability?
  • What impact do these promotions have on customer profitability?
  • How do I communicate and implement these promotions via the salesforce?
There are a number of good reasons why one might choose a simple price promotion:
  • Offensive sales gain – to offset competitive threats. Typically this may mean a situation where the supplier is prepared to forego short term profits.
  • Recover market share – sustaining a nominated loss of contribution to gain a position over competitors
  • Stimulate Sales – without a loss of contribution and hopefully an increase in overall profitability. This is probably the most common rationale for promotions. Implicit in this is that the company will increase sales revenue and thus the total profit from the promotion will be greater than if there were no promotion at all.
  • Reward – for existing brand loyal users. This may be a short-term loss of profitability and may even make money if a lot of brand loyal consumers stock up.
  • Switch – However, if there are a large number of promotions targeted at “deal loyal” users then they will switch brand frequently. When promoting to this group the best course of action is to make sure that the promotion is profitable as there may be no long-term future gains to be had.
  • Gets new users to Trial – for new products every new trial is valuable; this incentive is premised on the assumption that the long-term value of a new user may be worth many times the cost of the initial purchase, so the supplier is prepared to invest heavily to obtain a new consumer. This may justify the high cost of a promotion. Trade promotions of new items often need to be supported by other vehicles such as demonstrations and media advertising.
  • Reward to Trade. This often happens to get a buyer off your back. If however, it is viewed as being good for both parties, there should be a profit opportunity.
  • Because the trade threatens deletion – in many instances buyers have co-op budgets to achieve. There is pressure on suppliers to maintain ranging and promotion of your products in the category ensures support for your brand.
Each of these scenarios has different parameters of cost, price point, mechanic, vehicle and incremental volume gain. In reality the sales team gets a certain amount of money to spend on promotions, some say that these funds are a “cost of doing business”. The more money that is provided the more we will sell. If only this were true! We really need to understand how we can effectively apply the limited trade funds to maximise their efficiency.
Source: Wikipedia.



Saturday, 19 July 2008

Neeraj Nathani smart bridge Category management



Category management

Category management is a retailing and purchasing concept in which the range of products purchased by a business organization or sold by a retailer is broken down into discrete groups of similar or related products; these groups are known as product categories (examples of grocery categories might be: tinned fish, washing detergent, toothpastes). It is a systematic, disciplined approach to managing a product category as a strategic business unit.[1] The phrase "category management" was coined by Brian F. Harris.[n/a 1]

Category management in a retail context
Each category is run as a "mini business" (business unit) in its own right, with its own set of turnover and/or profitability targets and strategies. Introduction of Category Management in a business tends to alter the relationship between retailer and supplier: instead of the traditional adversarial relationship, the relationship moves to one of collaboration, with exchange of information, sharing of data and joint business building.
The focus of all supplier negotiations is the effect on turnover of the category as whole, not just the sales of individual products. Suppliers are expected, indeed in many cases mandated, to only suggest new product introductions, a new planogram or promotional activity if it is expected to have a beneficial effect on the turnover or profit of the total category and be beneficial to the shoppers of that category.
The concept originated in grocery (mass merchandising) retailing, and has since expanded to other retail sectors such as DIYcash and carrypharmacy, and book retailing.[2]


Definition of category management (retail)

Category management lacks a single definition thus leading to some ambiguity even among industry professionals as to its exact function. Three comparative mainstream definitions are as follows:
Category management is a process that involves managing product categories as business units and customizing them [on a store by store basis] to satisfy customer needs. (Nielsen)[3]
The strategic management of product groups through trade partnerships which aims to maximize sales and profit by satisfying consumer and shopper needs (Institute of Grocery Distribution)[4]
.. marketing strategy in which a full line of products (instead of the individual products or brands) is managed as a strategic business unit (SBU). (Business Dictionary)[5]
The Nielsen definition, published in 1992, was a little ahead of its time in that customising product offerings on a store by store basis is logistically difficult and is now not considered a necessary part of category management; it is a concept now referred to as micromarketing. Nevertheless, most grocery retailers will segment stores at least by size, and select product assortments accordingly. Wal*Mart's Store of the Community, implemented in North America is one of the few examples of where product offerings are tailored right down to the specific store.[6]
Definition of a category
The Nielsen definition of a category, used as the basic definition across the industry is that the products should meet a similar consumer need, or that the products should be inter-related or substitutable.[8] The Nielsen definition also includes a provision that products placed together in the same category should be logistically manageable in store (for example there may be issues in having room-temperature and chilled products together in the same category even though the initial two conditions are met).
However, this definition does not explain how the process often works in practical retailing situations, where demographic or marketing considerations take precedence.
The category management 8-step process (retail)
http://upload.wikimedia.org/wikipedia/en/thumb/b/b9/8-step-process.gif/220px-8-step-process.gif
http://bits.wikimedia.org/static-1.21wmf12/skins/common/images/magnify-clip.png
The category management 8-step process
The industry standard model for category management in retail is the 8-step process, or 8-step cycle developed by the Partnering Group.[9] The eight steps are shown in the diagram on the right; they are :
  1. Define the category (i.e. what products are included/excluded).
  2. Define the role of the category within the retailer.
  3. Assess the current performance.
  4. Set objectives and targets for the category.
  5. Devise an overall Strategy.
  6. Devise specific tactics.
  7. Implementation.
  8. The eighth step is one of review which takes us back to step 1.
The 8-step process, whilst being very comprehensive and thorough has been criticized for being rather too unwieldy and time-consuming in today's fast-moving sales environment; in one survey only 9% of supplier companies stated they used the full 8-step process.[10] The current industry trend is for supplier companies to use the standard process as a basis to develop their own more streamlined processes, tailored to their own particular products[11]
Market research company Nielsen has a similar process based on only 5 steps : reviewing the category, targeting consumers, planning merchandising, implementing strategy, evaluating results

Category captains

It is commonplace for one particular supplier into a category to be nominated by the retailer as a category captain. The category captain will be expected to have the closest and most regular contact with the retailer and will also be expected to invest time, effort, and often financial investment into the strategic development of the category within the retailer.
In return, the supplier will gain a more influential voice with the retailer. The category captain is often the supplier with the largest turnover in the category. Traditionally the job of category captain is given to a brand supplier, but in recent times the role has also gone to particularly switched-on private label suppliers.[12]
In order to do the job effectively, the supplier may be granted access to a greater wealth of data-sharing, e.g. more access to an internal sales database such as Walmart's Retail Link

Category management in purchasing
Category management can also be applied to purchasing within an organisation. Although the term is the same and there are many similarities with elements of retail category management including the use of similar tools and techniques applied in reverse, the methodology is fundamentally different. Applying Category Management in purchasing benefits organisations by providing an approach to reduce the cost of buying goods and services, reduce risk in the supply chain, increase overall value from the supply base and gain access to more innovation from suppliers. It is a strategic approach that focuses on the vast majority of organisational spend. If applied effectively throughout an entire organisation the results can be significantly greater than traditional transactional based purchasing negotiations.
The concept of Category Management in purchasing originated in the late 80's. There is no single founder or originator but the methodology first appeared in the automotive sector and has since been developed and adopted by organisations worldwide. Today Category Management is considered by many global companies as an essential strategic purchasing approach. Category Management has been defined as “an evolving methodology that drives sourcing strategy in progressive organisations today”.[15]
The Chartered Institute of Purchasing & Supply defines Category Management as:
"organising the resources of the procurement team in such a way as to focus externally onto the supply markets of an organisation (as against having a focus on the internal customers or on internal Procurement departmental functions) in order to fully leverage purchasing decisions”.[16]
Jonathan O'Brien, author of Category Management in Purchasing, defines Category Management as:
"the practice of segmenting the main areas of organisational spend on bought-in goods and services into discrete groups of products and services according to the function of those goods or services and, most importantly, to mirror how individual marketplaces are organised. Using this segmentation organisations work cross functionally on individual categories, examining the entire category spend, how the organisation uses the products or services within the category, the marketplace and individual suppliers.",[17]
Peter Hunt, partner at ADR International, writes
“the term category management can mean different things to different people, so a working definition is needed. A ‘category’ is the logical grouping of similar expenditure items, such as spend on advertising agency services or IT hardware. Category management is the sourcing process used to manage these categories to satisfy business needs while maximising the value delivered from the supply base”.[18]
Many public sector organisations have recently adopted category management as a strategic transformation tool. Sir Philip Green, in his “Efficiency Review” of UK government spending, recommended that “centralised procurement [should be] mandated for common categories to leverage this buying power and achieve best practice”.[19]
Source: Wikipedia.