SlideShare a Scribd company logo
1 of 21
Download to read offline
Transforming
Big DataYour Agency with
2.GOVERNMENTBIGDATA1. THEGOVLOOPGUIDE
W E L C O M E / C O N T E N T S
ForEward: Bob Gourley, Founder, CTOVISION - - - - - - - - - - - - - - - - - 3
Executive Summary - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 5
The State of Big Data: Highlights from the GovLoop Survey - - - 8
Figure 1: Big Data Impact on Mission Areas	 9
Figure 2: Where Does Your Agency Data Come From?	 9
Figure 3: Who Creates Your Agency’s Data?	 10
Figure 4: What has been the core driver for big data initiatives?	 10
Leading the Way: Big Data Lessons from Philadelphia - - - - - 14
Expert Insights with Mark Headd, Chief Data Office, City of Philadelphia	 14
Challenges to Adopting Big Data at the City of Philadelphia	 15
From the GovLoop Survey: Challenges to Implementing Big Data Initiatives	 17
Best Practices to Implementing Big Data Initiatives	 16
5 Steps to Leverage Big Data in Your Agency - - - - - - - - 20
Expert Insights with Shawn Kingsberry, Chief Information Officer, Recovery Accountability 			
	 and Transparency Board (RATB)	 20
1. Identify a Clear Business Need or Problem	 22
2. Identify Risks and Issues	 22
3. Craft a Clear Vision	 23
4. Identify Resource Needs	 23
5. Enable and Optimize Services	 24
Achieving Workforce Efficiencies with Big Data - - - - - - - - - 25
An interview with industry expert, Audie Hittle, Chief Technology Officer (CTO) Federal 				
	 Market at EMC Isilon.	 25
How to Identify Actionable Insights from Big Data - - - - - - - - - 27
An Interview with Industry Expert, Pat Herbert, Principal Solutions Architect, SAS	 27
Using Big Data to Prevent Waste, Fraud and Abuse - - - - - - - - 30
Controlled Data	 32
Real-Time Data	 32
Synthesized Data	 32
Does Congress Mandate Duplication?	 32
Guide Synopsis and Big Data Resources - - - - - - - - - - - - - - - 33
Your Big Data Cheat Sheet	 33
5 Next Steps and Conversation Starters	 35
Acknowledgements - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 37
About GovLoop - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 38
Resources - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 39
4.GOVERNMENTBIGDATA3. THEGOVLOOPGUIDE
overnment technology decision makers in all three
branches of federal government and from many States
consistently tell me about an issue they have with “Big
Data”. This is an issue you have seen too I’m sure. The is-
sue is a lack of discipline and rigor over the use of the term itself.
What began as a concept describing a specific set of new capabili-
ties to enable analysis that could never be done before has become
a movement where every strategist, marketer and pundit seeks to
offer their own definition and use of the term. That is why I was so
happy to see GovLoop’s mission-focused approach to this issue. By
focusing on the missions of enterprises and then surveying real de-
cision-makers for issues they are helping bring discipline and focus
to the domain.
Why is discipline important at this stage? Do you remember service-
oriented architecture (SOA)? This concept led to tremendous new
capabilities and efficient, mission-focused designs. Enterprises es-
tablished architectures in which application interfaces, logic and
data were separated and smartly reusable. After the term went
mainstream, every company in the IT ecosystem grabbed onto it
and began to use the acronym SOA to mean anything they wanted
it to. Although it’s still a useful construct for IT professionals, when
it comes to interacting with industry, the term has now lost much of
its meaning.
If we let the term “Big Data”go the way of “SOA”we will sub-optimize
its use. If we keep a mission-focused discipline on the term we will
F O R E W A R D
help drive continuing improvement and optimize the insertion of
new innovative technologies into governments.
As you dive into this report keep the following definition of Big Data
in mind. It flows from Doug Laney’s famous articulation of the“Three
V’s” and is consistent with the collaborative efforts of the TechAmer-
ica foundation and with our reporting at CTOvision.com and with
the community edited WikiPedia entry for Big Data:
Big Data: A phenomenon defined by the rapid acceleration in the
expanding volume of high velocity, complex and diverse types of
data. Big Data is often defined along three dimensions– volume,
velocity and variety.
Big Data Solutions: Advanced techniques and technologies to
enable the capture, storage, distribution, management and anal-
ysis of information. A Big Data solution uses new approaches for
sense-making over large quantities of data, such as in the Apache
Hadoop Big Data Platform.
Please keep these terms in mind as you review this Govloop guide
to Transforming Your Agency with Big Data. The insights you find
here will help you learn from others who are also on the journey and
will also help you speed along the Big Data projects you may already
have underway.
Bob Gourley
http://ctovision.com
http://crucialpointllc.com
bob@crucialpointllc.com
703 994 0549
6.GOVERNMENTBIGDATA5. THEGOVLOOPGUIDE
he way agencies store, manage and
collect data is changing. In the past,
agencies analyzed data from stable
enterprise services. Data was created
from customer relationship management ser-
vices, enterprise resource planning systems or
from the variety of financial instruments agen-
cies used to process transactions. Agencies
could then run common reports, store data in
warehouses or databases, and easily extract
knowledge to inform their decision-making.
With the explosion of data from social media,
the Internet and growing examples of online
transactions, government has more opportu-
nities than ever before to transform agencies
through big data analysis.
Through qualitative and quantitative analysis,
this report will highlight the common chal-
lenges, best practices and pertinent issues sur-
rounding big data. Transforming Your Agency
Through Big Data includes a survey from 215
public sector professionals, and interviews
with government and industry thought lead-
ers. Expert interviews include:
Nikki Clowers, Director of Financial Markets and
Community Investment Issues at GAO
Mark Headd, Chief Data Officer, City of Philadel-
phia
Audie Hittle, Chief Technology Officer (CTO), Fed-
eral Market at EMC Isilon
Jennifer Kerber, President of the TechAmerica
Foundation
Shawn Kingsberry, Chief Information Officer, Re-
covery Accountability and Transparency Board (RATB)
Pat Herbert, Principal Solutions Architect, SAS
E X E C U T I V E S U M M A R Y
Our report identifies that government agen-
cies are still at the early stages of adopting
big data initiatives. To fully leverage big data
analysis, agencies are in need of guidance and
best practices to fully capitalize on the data
that they are collecting. In our survey, GovLoop
found that education (19%), acquiring infra-
structure (18%), and confidentiality and access
control (16%) were some of the challenges fac-
ing government.
Additional findings highlight the ways govern-
ment has leveraged big data. The survey finds
that budget/finance (14%), communications/
public affairs (14%) and health and human ser-
vices (11%) were the leading mission areas in
which organizations have leveraged big data
analysis. Additionally, the survey finds that
the majority of organizations have yet to hire
a data scientist, as 61% of respondents do not
have data scientist on staff. To begin to craft
big data strategies, GovLoop believes that
agencies should:
1. Consider parallels and lessons learned
from existing open data initiatives.
2. Identify resource needs and staffing.
3. Be strategic and develop clear vision
statement and goals.
4. Work diligently to extract knowledge
from legacy systems and unstructured data.
5. Government to government collabora-
tion is essential, agencies need to focus on
standardizing data and developing shared
infrastructures.
This report concludes with a big data cheat
sheet, as a means to quickly get the ‘need to
know’ facts on big data and a brief outline
of the key findings in this report. As budgets
continue to plague the public sector, agencies
are searching for new efficiencies and innova-
tive ways to find actionable insights from big
data analysis. This report can serve as the first
step for your agency to harness the power of
data, and improve decision-making, informa-
tion sharing and service delivery of the agency
through data analysis.
With the explosion of data from
social media, the Internet and
growing examples of online
transactions, government has
more opportunities than ever
before to transform agencies
through big data analysis.
8.GOVERNMENTBIGDATA7. THEGOVLOOPGUIDE
ecently, GovLoop conducted a sur-
vey on big data applications across
government. The survey included
215 responses primarily from a fed-
eral audience (41%), and also in-
cluded participants from state level employees
(24%), local government (23%) and contribu-
tions from academia and industry members
(12%). Throughout this report, GovLoop shares
additional findings from our survey.
One question explored,“Do you or your organi-
zation use big data in a way that has an impact
on any of the following mission areas?” Re-
spondents could choose from acquisition/con-
tracting, budgeting/finance, communications/
public affairs, economic development, emer-
gency management, environmental protec-
tion, health and human services, parks and rec-
reation, public works, property management
and transportion. The results can be found in
Figure 1. Respondents indicated the top three
results for big data applications were for bud-
geting/finance (14%), communications/public
affairs (14%), and health and human services
(11%). Respondents also had the chance to
submit other ways they are leveraging big data
analysis on mission areas, participants identi-
The State of Big Data
H i g h l i g h t s f r o m t h e G o v L o o p S u r v e y
10.GOVERNMENTBIGDATA9. THEGOVLOOPGUIDE
fied areas such as performance
measurement, security and
defense and education and
skill development.
Kimberly Denz, Business Sys-
tems Analyst, Mississippi De-
partment of Marine Resources,
provided some ways that big
data is starting to be lever-
aged by the State of Mississip-
pi for mission centric activities.
Denz provided the example
of monitoring coastal ecol-
ogy and tracking compliance.
Denz states that it is difficult
to know if the agency is out
of compliance because of how
many permits have been is-
sued, which can be capped to
preserve coastal plains and the
environment. Another scenar-
io Denz identifies is leveraging
existing data across agencies.
The scenario she provides is
imagining if the Mississippi
Marine Patrol cites an indi-
vidual for a violation, they can
then check and know if the in-
dividual is wanted by the FBI,
and proceed appropriately.
Additional questions explored
where agency data came from
(Figure 2), and who creates
agency data (Figure 3). The
survey shows that the leading
way respondents collect data
is through capturing informa-
tion from documents, whether
they are print or digital. Clear-
ly, with the growth of self ser-
vice platforms, and increasing
examples of transactions per-
formed online, government is
flooded with documents, and
they serve as one of the prima-
ry sources of data for organiza-
tions. Additionally, web data
and email both were in the top
three for data sources.
As more services move to the
web, these findings are consis-
tent with the emerging ways
constituents engage with gov-
ernment. Respondents stated
Where Does Your Agency
Data Come From? (Figure 2)
Big Data Impact on
Mission Areas (Figure 1)
Do you or your organization use big data in a way that has an impact on any of the fol-
lowing mission areas? (Please select all that apply)
that data is created through
direct collection strategies, en-
vironmental monitoring and
research, licensing and geo-
spatial information systems
(GIS).
Figure 3, which highlights data
creators, shows that most of
the data created by govern-
ment is from internal stake-
holders, as in employees, from
internal processes or through
various inter-governmental
collaborations. Some of the
key results from figures 3 and
4 are:
Data that government col-
lects is varied
Need to find insights from
multiple sources of data
Standardization continues
to be a challenge
Legacy systems make it
challenging to access his-
torical data
Acquisition/C
ontracting
Budgeting/Finance
C
om
m
unications/
Public
Affairs
Econom
ic
D
evelopm
ent
Em
ergency
M
anagem
ent/
Fire/Police
Environm
ental
Protection/Services
H
ealth
and/or
H
um
an
Services
Parksand
Recreation
Public
W
orks
Property
M
anagem
entTransportation
4%
8%
14% 14%
9%8%8%
11%
6%
8%
5%
C
ustom
er
Relationship
M
anagem
ent(C
RM
)System
s
TransactionalEnterprise
Resource
Planning
(ERP)data
SocialM
edia/
SocialD
ata
M
achine-generated/
sensor
data
M
etadata
Em
ail
14%
19%
10% 10%9%
11% 11%
8%
D
ocum
ents
W
eb
data
12.GOVERNMENTBIGDATA11. THEGOVLOOPGUIDE
The survey also explores what
the core drivers for big data
adoption has been. Our survey
finds that the main reason gov-
ernment is adopting big data
initiatives is due to increasing
needs to find efficiencies in
government. Following effi-
ciencies is the desire to opti-
mize services based on trends.
Clearly, government organi-
zations are looking to use big
data to improve the service
delivery for citizens, and iden-
tify new and emerging ways to
optimize and streamline pro-
cesses. Survey respondents
mentioned, they have adopted
big data programs for “holistic
perspective of complex issues,”
and “Support of increased ana-
lytical capabilities by organiza-
tion.”
The GovLoop survey provided
a snapshot of how agencies are
planning to use, or how they
are using big data analysis. In
many cases, this is uncharted
territory for government agen-
cies. In the following sections
of this report, GovLoop spoke
with government and indus-
try leaders who are leading
the way with big data analysis.
Through their expert insights,
government agencies can
learn the best practices and
craft strategies to help trans-
form their agency through big
data.
Who Creates Your
Agency’s Data?(Figure 3)
What has been the
core driver for big
data initiatives? (Figure 4)
27%
Citizens
Internal processes
Public information
Staff
Collaborate with other agencies
13%
24%
14%
19%
Cost Savings
Efficiencies
Demands for service
upgrades by customers
Deciphering waste,
fraud and abuse
Optimize services
based on trends
Support of big data initiatives
by senior leadership
9%
9%
10%
13%
23%
26%
14.GOVERNMENTBIGDATA13. THEGOVLOOPGUIDE
EXPERT INSIGHTS WITH MARK
HEADD, CHIEF DATA OFFICER, CITY
OF PHILADELPHIA
n August 2012, Philadelphia Mayor Mi-
chael Nutter named Mark Headd as the
City’s first Chief Data Officer. In this role,
Headd is responsible for overseeing
open data and transparency initiatives across
Philadelphia. In this report, Headd provides
his expert insights on how municipal govern-
ments can leverage big data, the relationship
between big data and open data, and identi-
fies lessons learned and insights for agencies
to craft big data strategies.
The City of Philadelphia is still exploring how
to effectively leverage big data to improve
citywide operations. Headd notes that the city
has started several pilot programs that com-
bine city data with data obtained from various
social networks and internal resources. Headd
states, “Along with most cities, we are very
much at the very beginning stages of adopt-
ing big data programs.” In many cases, big data
programs are still in their nascent stages, and
this section of the report highlights Headd’s
expert insights on how to leverage data to im-
prove public sector decision-making.
Headd defines big data as, “the extraction of
big ideas from data, regardless of the size of
data.” For the City of Philadelphia, big data is
not as much about specialized technology,
such as Hadoop and MapReduce, as it is about
collaboration and extracting meaningful in-
formation from data across agencies and de-
partments. “Big data is less about the size of
Leading the Way
B i g D a t a L e s s o n s f r o m P h i l a d e l p h i a
16.GOVERNMENTBIGDATA15. THEGOVLOOPGUIDE
big data and more about the
extraction of actionable intel-
ligence of data,” stated Headd.
Headd continues to describe
the difference between federal
and local applications of big
data: “Philadelphia does not
have petabytes of data, we are
not the census bureau, we are
not the federal government, at
a municipal government scale,
and even at the state level, it’s
less about specialized tech-
nology, and its more about
data across departments and
across agencies.” Although
Headd identifies that Philadel-
phia is not collecting the same
volume of data as the federal
government, across all levels
of government, agencies are
challenged to break down si-
loes and work collaboratively
to share data, which can pro-
vide leaders with new insights
and improved decision-mak-
ing.
Challenges to
Adopting Big Data
at the City of
Philadelphia
As the City of Philadelphia be-
gan to explore big data initia-
tives, the city faced two core
challenges, extracting knowl-
edge from legacy systems and
a fragmented style of gover-
nance.
ment decisions were made.
The challenge with legacy sys-
tems is that they make it chal-
lenging on a enterprise wide
scale to:
Extract data
Share data
Combine data
Analyze date
“The problem is that the tools
for using data have devel-
oped so quickly and become
so powerful that they really
highlight the fact that when
IT investment decisions were
made, they often were made
without the foresight that
someday ‘we’d want to do dif-
ferent things with this data,’
and I don’t think that is unusu-
al across government,” states
Headd.
CHALLENGE 2: SHARING DATA
WITHIN A FRAGMENTED
GOVERNMENT STRUCTURE
Typically, a fragmented gov-
ernment is used to describe the
relationship between county
and city government – with no
central authority. Here we are
using the term ‘fragmented’ to
describe the multiple agencies
and actors involved with data
collection and service delivery
within the City of Philadelphia.
Within the City there are mul-
tiple government entities serv-
ing the needs of citizens. For
instance, to name a few:
CHALLENGE 1: EXTRACTING
KNOWLEDGE FROM OUTDATED
LEGACY SYSTEMS
A legacy system is simply an
antiquated technology or ap-
plication that government
uses. In many cases, outdated
technology makes it very chal-
Transportation authority
that runs trains, buses and
the subway
School district that oper-
ates independently from
the City of Philadelphia
Separate parking author-
ity that operates street and
lot parking throughout the
city
Public safety programs
lenging for organizations to
extract data and identify value.
As Headd states,“people didn’t
even know what would be pos-
sible with modern systems. We
simply didn’t know what we
didn’t know.” Headd identified
that many of the technologies
available today were not on
anyone’s radar when invest-
This means that there is sub-
stantial overlap of services by
government agencies, creat-
ing multiple data sets. “Data
often within the same govern-
ment is often dispersed, and
data is in different formats, in
different systems and siloed,”
states Headd. For Headd, a
core challenge is to combine
data sets, bring in additional
data, such as social media, and
then work to extract action-
able intelligence from data.
“The problem is that the tools
for using data have devel-
oped so quickly and become
so powerful that they really
highlight the fact that when
IT investment decisions were
made, they often were made
without the foresight that
someday ‘we’d want to do dif-
ferent things with this data,’
and I don’t think that is un-
usual across government”
- Mark Headd, Chief Data Officer, City of Philadelphia
From the GovLoop Survey: Challenges to
Implementing Big Data Initiatives
(Figure 5)
Our survey explored challenges to big data. The data in Figure 5 shows that
agencies are faced with a myriad of challenges on adopting big data, and
still in the early stages of big data adoption, learning and working through
challenges to many challenges to implement big data programs.
Acquiring infrastructure
Education
Leadership
Data privacy
Cyber security
Confidentiality and access control
19%
18%
16%
15%
13%
13%
18.GOVERNMENTBIGDATA17. THEGOVLOOPGUIDE
erational side of government,”
states Headd.
Open data and big data have a
lot of parallels. In both cases,
agencies are forced to think
about how to leverage data to
serve the most critical func-
tions. Along the way, agencies
must consider security impli-
cations, work with customers
to meet needs (could be a citi-
zen or an agency), and clearly
identify success metrics.
3 STEPS TO LEVERAGE OPEN
DATA TO IMPROVE BIG DATA
PROGRAMS
1. Open data and big data
have parallels to adoption
2. Process to open data to
external clients is similar to
leveraging data internally
3. Focus on the process and
think strategically on data
usage
“When agencies go through
the process of opening data
up for public consumption
agencies have to go through a
lot of the same steps that they
would need to go through to
share data internally, so it re-
ally sort of changes the way
people think about data,”
states Mark Headd, Chief Data
Officer, City of Philadelphia
BUILD INFRASTRUCTURES THAT
SCALE AND ARE EASILY SHARED
Headd noted that agencies did
not prepare for future needs
while making IT investments,
which hindered the ability to
extract knowledge from legacy
systems. Headd states, “Hope-
fully these lessons will allow
us to make smarter investment
decisions in the future.”
To work around old legacy sys-
tems, Headd and his team are
re-engineering infrastructure
to rethink and redefine the way
the city shares data between
agencies and departments.
In doing so, Philadelphia can
more efficiently use data to
inform operational decisions
and focus on cloud computing
and data storage offerings that
easily scale to meet demands.
With increasing volumes of
data, Philadelphia has learned
that the ability to scale servic-
es is essential to meeting the
needs of government agen-
cies.
Yet a scalable infrastructure is
only half the equation. Agen-
cies must also focus on share-
able infrastructures, thinking
of new and innovative ways
agencies can access data and
information across the entire
enterprise. This will help to
avoid the fragmented nature
of data, siloes and facilitate
improved information sharing.
Headd states, “Philadelphia
does not have data that is just
big, but we have big problems.
The key to getting at those
problems will be creating a
shareable infrastructure.” Le-
veraging big data will contin-
ue to be essential in facilitat-
ing improved decision making
for the public sector.
Headd’s insights provide a sol-
id foundation for agencies to
build their big data initiatives.
As the public sector contin-
ues to develop more kinds of
data, and the need for thor-
ough data analysis continues
to grow in importance, identi-
fying strategies and best prac-
tices for big data programs is
essential. Philadelphia is one
of many cities starting to lever-
age data in new and emerging
ways, which is transforming
the way government operates
and modernizing agencies.
was the relationship between
open data and big data, and
from Headd’s perspective, how
open data initiatives can lead
organizations to develop big
data programs. Additionally,
Headd asserts the importance
of scaling services and offer-
ings to meet future demand.
CONSIDER LESSONS FROM OPEN
DATA INITIATIVES
During the interview, Headd
explored how big data dif-
fers from open data. Headd’s
insights show that both are
interconnected, but serve a
different mission need for gov-
ernment agencies. While open
data is used for outside con-
sumers to make informed data
based decisions, big data is
used for organizations to make
decisions at the enterprise lev-
el. For instance, an open data
initiative may allow citizens
to report potholes for the city
transportation to fix, while a
big data initiative may iden-
tify traffic patterns to learn
what areas of the community
need to be allocated funding
to upgrade roads and infra-
structure. Open data focuses
on the government-to-citizen
relationships, while big data
focuses on government-to-
government relationships.
Headd provides more clarity
on the distinction between big
data and open data: “Big data
is more about organizations
using data to inform their own
decisions, where as open data
is more about giving the pub-
lic, outside consumers data to
inform what they do, decisions
they make.”
Although big data and open
data are slightly different,
Headd recommends prior to
starting a big data initiative,
agencies should explore open
data programs. “I always de-
scribe open data as the gate-
way drug to big data, because
it makes government think
about there data differently,
open data makes government
think more strategically about
their data, it makes them think
about the share-ability of data,
which is one of the big hin-
drances to using big data and
to using data to inform better
decision making on the op-
This is an enormous task for
the City of Philadelphia, but
is a core requirement for the
city to advance big data pro-
grams. Headd is working to
create a “shareable infrastruc-
ture,” where agencies can eas-
ily access and leverage data
citywide. This will be essential
to capitalizing on the various
kinds of data that the city col-
lects, identifying new insights
and improving the operations
of government.
Best Practices to
Implementing Big
Data Initiatives
Although big data is just be-
ginning in the City of Phila-
delphia, Headd provides his
thoughts on what agencies
can do to leverage big data
programs. Like with most IT
investments, one of the first
steps is to clearly state the
business problem, and how
a robust use of big data will
help achieve the organiza-
tion’s end goals. One of the in-
teresting insights from Headd
3 INFRASTRUCTURE NEEDS FOR BIG DATA
1. Scalable offerings to meet increasing demands from stakeholders
2. Shareable infrastructure to facilitate collaboration across departments
3. Re-engineer systems to upgrade legacy systems to access historical data
For the City of Philadelphia, big data is not as much about
specialized technology, such as Hadoop and MapReduce, as
it is about collaboration and extracting meaningful infor-
mation from data across agencies and departments.
20.GOVERNMENTBIGDATA19. THEGOVLOOPGUIDE
Expert Insights with Shawn
Kingsberry, Chief
Information Officer,
Recovery Accountability and
Transparency Board (RATB)
n an interview for this report, Shawn
Kingsberry, Chief Information Officer, Re-
covery Accountability and Transparency
Board (RATB), highlighted some of the
innovative practices he is leading surround-
ing big data and emerging technology. Kings-
berry’s comments highlight the importance of
leveraging big data in government, and how
big data can facilitate new insights and stream-
line efficiencies for federal agencies. Currently,
agencies are looking to data as a means to dis-
cover innovative solutions to complex public
sector challenges. This section will highlight
Kingsberry’s work at the RATB, and five steps to
leverage big data within a federal agency.
The Recovery Accountability and Transparency
Board (RATB) is an independent agency within
the federal government. This places the RATB
in a unique position of being a government
agency that is independent of political agenda
and partisan politics. RATB’s mission is to pro-
vide extensive transparency insights to federal
programs as well as prevent waste, fraud and
abuse related to how Recovery Act funds are
spent. Recovery.gov, one of RATB’s transpar-
ency websites, provide the opportunity for the
public to explore recovery funds within their
community. Citizens can visit the site to look
at maps that provide an overview of where
5 Steps to Leverage Big
Data in Your Agency
22.GOVERNMENTBIGDATA21. THEGOVLOOPGUIDE
Recovery Funds are going,
or to research the way funds
are used by entering their zip
code. Additionally, constitu-
ents can even report instanc-
es of fraud, waste, apply for
grants, and even share the raw
or visualized data, which cre-
ates improved transparency
and involvement in govern-
ment activities by citizens.
Big data is more than the col-
lection and storage of exten-
sive volumes of data. Agen-
cies need to leverage data to
improve services and to do so,
data must be organized and
structured so information can
be digested and used to reach
agency goals. However, with
the lack of standardization of
data between agencies and
the absence of established
data communications be-
tween agencies, sharing and
using data to optimize trans-
parency and agency objec-
tives across government has
become a daunting task for
organizations. “From the fed-
eral standpoint, we have a lot
of work to do,” states Kingsber-
ry, especially as the amount of
data developed every month
has grown exponentially and
is predicted to keep growing
at an astounding rate. Kings-
berry states:
“When you look at the expect-
ed amount of data that’s going
to be transferred per month
externally across the web, the
expectation is that by 2021
we’re going to be looking at
180,000 petabytes per month.
If you go all the way back to
the other side of the spectrum,
in 1990 we were under 20,000
petabytes per month. That
gives you the growth of tech-
nologies that have been com-
ing online that enable custom-
ers, citizens, and government
to be more connected,”
With increasing volumes of
data, government agencies,
such as the Recovery Ac-
countability and Transparency
Board, must put a focus on
understanding the data and
ensuring accuracy. This also
calls attention to the implica-
tions for addressing changes
in public outreach; Kingsberry
states, “The expansive amount
potential to lead to more suc-
cessful agency activities, and
a more satisfied constituency.
Below are fives ways, as indi-
cated by Kingsberry, that an
agency can create a successful
big data program.
1. Identify a Clear
Business Need or
Problem
Big data is an excellent tool
to use in order to better in-
form business decisions. To
fully leverage a big data initia-
tive and identify new insights
through big data programs,
agency leaders cannot just
haphazardly place big data
into a business strategy with-
out first identifying how data
can be properly used. “The
first thing is for federal gov-
ernment to get their head
around business requirements
and not get caught up in the
buzzwords and the technol-
ogy of what seems interesting
right now,” warns Kingsberry.
With the rapid dissemination
of information on the Internet,
buzzwords can lead to hype
and premature dedication to a
specific technology program.
Not every new computing ad-
vancement or mobile strategy
will fit every agency. Federal
agencies must understand
their business objectives and
how data can be part of the
solution, prior to committing
time and money into a big
data project or program.
an agency such as the Recov-
ery Accountability and Trans-
parency Board where data
needs to be collected from ev-
ery recovery aid-related agen-
cy. Once the issue is properly
identified federal data sharing
will have, according to Kings-
berry, “a lot of opportunity for
maturity.”
Another issue that agencies
must be prepared to face is re-
alizing that poor collaboration
and communication within an
agency may also be a challenge
in addition to implementing
new technology. “Technol-
ogy is not the challenge. If you
get the right technical people
sitting at the table, you can
solve any technology prob-
lem. The challenge is people
and culture,” states Kingsberry.
Departments have their own
culture and way of working
through issues, but those cul-
tures may clash. To avoid con-
flicting ideas, Kingsberry sug-
gests that agencies “Remove
technology from the conversa-
tion. Talk at the business level
about the outcome. With the
of growth is telling you that
new customers and new users,
are going to have expectations
that when they ask questions
they will get performance and
integrity from the data.”There-
fore, improved performance
and service delivery can only
happen if data is accurate and
timely.
Big data, when used in a
quickly assembled govern-
ment strategy, can become
cumbersome and leave em-
ployees and constituents more
overwhelmed and confused.
However, when big data initia-
tives are thought out and de-
veloped out of concise agency
objectives, big data has the
2. Identify Risks
and Issues
Working with raw data and
large sets of data can be chal-
lenging in government. Agen-
cies are often working with in-
formation that should remain
private within the agency and
not shared externally. It is im-
portant to recognize the na-
ture of the data before imple-
menting a strategy. However,
sometimes the issue is of an
opposite nature. Government
agencies can often be isolated
from each other and have diffi-
culty sharing information with
other agencies. “If one of your
risks is ‘we need to do a better
job providing more quality in-
formation or a more useful sit-
uation to our customers,’ and
to get there requires you to
connect with other data sourc-
es that are outside of your
agency, you have another is-
sue,” says Kingsberry. To obtain
the best information to make
the most informed decisions,
agencies need to connect and
share data sets, especially in
Federal Data Growth:
By the Numbers
2021
1990
180,000 petabytes
20,000 petabytes
month
month
24.GOVERNMENTBIGDATA23. THEGOVLOOPGUIDE
of data integrity.” These ques-
tions can help agency leaders
know not only the limitations
of the data, but also the poten-
tial of the data. They can then
understand how to leverage
data in the best way to accom-
modate the growing expecta-
tions of customers and to fit
into a plan designed by lead-
ers of the agency. Recognizing
the scope will allow agencies
to properly leverage data to
accomplish the agency’s mis-
sion objectives.
4. Identify
Resource Needs
While big data is extremely
helpful when leveraged to
make decisions, agencies need
to understand the resources
that they have and extract ac-
tionable insights from data.
Kingsberry advises when im-
plementing a new technology,
whether it is a mobile strategy
or utilizing the cloud, agencies
need to look and understand
their portfolios. A portfolio
is a list of technologies and
their appropriations, laying
out the limitations of techno-
logical and fiscal resources of
an agency. “In essence, it is all
about project management
and portfolio management,”
says Kingsberry. He cautions,
“Agencies don’t have to think
differently,”meaning analyzing
and understanding your re-
source needs is not just about
thinking innovatively outside
of the box. Instead, agencies
must identify objectives and
recognize the work that must
be done in order to accom-
plish their goals. To do this,
Kingsberry suggests asking
certain questions about your
portfolio:
What are agency risks and
issues associated with de-
livering the goals and ob-
jectives to meet the vision
of my portfolio?
How can technology better
optimize the outcome, and
better meet goals and ob-
jectives of the agency?
5. Enable and
Optimize Services
Kingsberry pointed out that
very recently, the RATB was
able to “run two million re-
cords against 100 million rows
in roughly two minutes,” a pro-
cess that used to take hours,
if not days, to run. “We’re con-
stantly looking to optimize,”
states Kingsberry. The ability
to quickly and efficiently find
knowledge out of data means
that data can become more
actionable, and lead to stron-
ger insights for improved de-
cision-making. For instance, at
the RATB, the ability to quickly
process millions of records
leads to improved decisions
around Recovery Funds and
transparency initiatives.
The purpose of the Recovery
Accountability and Transpar-
ency Board is to provide in-
formation to the public about
Recovery funds so that other
agencies, businesses and in-
dividuals can see where gov-
ernment money is going.
Publishing a report or post-
ing information on a website
is helpful in reaching out to
constituents but in order to
optimize activities and trans-
parency, agencies need to
consider mobile technology.
At RATB, “customers can access
our infrastructure via tablets,
because of the infrastructure
when you look at our analytic
cloud. So in essence, that is
mobile and mobile is a way of
interacting with the data,” says
Kingsberry.
As previously stated, big data
is more than just acquiring im-
menseamountsofinformation,
big data is about actionable
insights and is an important
part of a digital government
strategy. “You can’t talk big
data without talking mobile,
without talking cloud, and
without talking information
assurance. They all go hand
in hand because at the end of
the day it’s all about the data.
Everything else is how you in-
teract with that data.” If agen-
cies leverage the data sets that
they acquire and utilize tech-
nologies such as mobile and
cloud, then they will be able to
better serve their constituents
and meet agency objectives.
The important action to take,
as Kingsberry has expressed,
is to first identify the scope
of the data and to fit that into
the mission of an agency. Once
that is accomplished, big data
can aid government agencies
in improving transparency and
public services.
right people, the business side
and the technology side of the
organization will be sitting at
the table together. What you’re
going to see is that you are go-
ing to begin to get people on
the same page.”
3. Craft a Clear
Vision
Good leaders not only craft a
clear vision, but also know the
attributes, quality, and integri-
ty of data to set realistic expec-
tations. To better understand
data, Kingsberry suggests that
agencies ask questions such as
“What is the data? What are its
attributes? What is the level of
quality of the data?This assures
that I have an appropriate level
From the GovLoop Survey: Does Your
Organization Have Data Scientists
on Staff? (Figure 6)
As education was identified as one of the main challenges for big
data initiatives, 61% of agencies indicated they do not have data
scientists on staff. This information is further evidence that an es-
sential part to adopting big data will mean providing new training
opportunities for existing employees, and leveraging their skill sets
in new ways. Although the title “data scientist” may not be a formal
role within an agency, leaders must certainly continue to train em-
ployees to serve in a data scientist capacity. This means leaders must
have employees on staff that focus on data, and learn the best ways
to identify intelligence from data collected across the agency or de-
partment, and collaborate with partnering agencies. 	
39%
61%
No
Yes
“You can’t talk big data without talking mobile, without talking
cloud, and without talking information assurance. They all go
hand in hand because at the end of the day it’s all about the
data. Everything else is how you interact with that data.”
26.GOVERNMENTBIGDATA25. THEGOVLOOPGUIDE
Recently, Audie Hittle, Chief
Technology Officer (CTO), Fed-
eral Market at EMC Isilon, shared
his insights as to how big data
initiatives are transforming gov-
ernment and the role of govern-
ment employees. As Hittle states, “We are only
at the tip of the iceberg and I believe big data
can be transformational.” Hittle’s statement
could not be more poignant, as agencies are
looking to streamline processes and identify
new efficiencies.
As this report has shown, big data analysis has
many benefits for government agencies; “One
of the areas big data certainly offers is the op-
portunity to make better decisions and make
more efficient use of all resources,”Hittle states.
Across all levels of government, focusing on
finding new efficiencies is essential, especially
in a time where budgets are being reduced,
coupled with high levels of fiscal uncertainty.
Yet, efficiency for government does not just
mean the benefits of quicker processing, more
efficient services, and improved decision mak-
ing. This also means the improved efficiencies
within the job of a government worker. Hittle
notes, efficiency “enables people to get more
gratification out of their job, because they feel
they are more efficient, they are accomplishing
more, they are contributing more, and those
are great things.”
Hittle shared a case study from the Air Force,
which identified the improved efficiencies for
the workforce. The Air Force implemented a big
data program and was able to reduce the num-
ber of dedicated storage professionals. In doing
so, the Air Force was able to reallocate staff and
place employees on more mission critical and
support roles. Hittle states, “in some cases you
can see where placing employees on mission
critical roles provides a career progression or
a career re-training opportunity to move from
one highly skilled area, where it deals with IT
management, into other areas where it deals
with knowledge extraction or analysis.”
The Air Force is not alone in making improve-
ments to the workforce. A second case study
comes from an intelligence agency, which
implemented an Isilon scale-out network-at-
tached storage (NAS) solution. With this solu-
tion, the agency was again able to reduce ser-
vice professionals by roughly 90% and, similar
to the Air Force, employees could be reallocat-
ed to higher priority and direct mission-orient-
ed services.
In addition to transforming how the workforce
operates, Hittle believes that big data will also
facilitate new opportunities for government
training. “What we are seeing here is that big
data is going to create efficiencies that are
going to lead to cross training and retraining
opportunities that enable people to migrate
quickly into these high priority roles,” states
Hittle.
Clearly, big data can help agencies transform
their decision-making and service delivery. The
impact on the government workforce cannot
be overlooked, with tightening resources, IT
managers must assure they are fully leverag-
ing emerging technology as a way to redefine
the role of a government employee, and fully
leverage their skills and knowledge. With new
efficiencies comes the ability to free workers
from monotonous, time-intensive tasks, and
allows workers to use their skills to contribute
to higher value mission-centric objectives.
BIG DATA
IT’S ON ISILON
•	 Store	&	AnAlyze	your	DAtA
•	 Protect	your	DAtA
•	 Secure	your	network
www.emc.com/federal
GAme-chAnGinG		
technoloGieS		
for	iSr	&	fmV
Case Study: Achieving Workforce Efficiencies with Big Data
An interview with industry expert, Audie Hittle, Chief Technology Officer (CTO) Federal Market at EMC Isilon
28.GOVERNMENTBIGDATA27. THEGOVLOOPGUIDE
Pat Herbert, Principal Solu-
tions Architect, SAS, recently
spoke with GovLoop on the
importance of big data, com-
mon challenges and how agen-
cies can leverage big data to
improve internal operations at a government
agency. Herbert’s insights show how agencies
can begin to find actionable intelligence from
big data, and leverage their data in new, inno-
vative ways.
Like all our expert interviews in this report,
Herbert cautions agencies not to get lost in de-
fining big data in terms of size or scale. Herbert
states, “We do not define big data as a func-
tion of scale or size exclusively. Big data is the
amount of data or the complexity of data that
exceed a given users comfort, their ability to
handle that data in ways they have tradition-
ally handled it, so it is something that’s bigger
than they have dealt with in the past but big-
ger does not always mean size”
For Herbert, the ultimate goal is taking big data
and finding new value, actionable insights and
using data as a strategic tool to transform an
agency. During the interview, Herbert men-
tioned some common challenges and best
practices for big data analysis. One of the first
challenges that Herbert mentions is the chal-
lenges related to governance, “Ultimately a
challenge is a data governance issue, the abil-
ity to use the data the way agencies need to in
order to access, but also in a way that is effec-
tive for agencies.”
Governance challenges are also multiplied as
data is often fragmented across a variety of dif-
ferent agencies. Along with governance chal-
lenges, this also results in challenges related to
collaboration and extracting value from data.
“The challenge is not having data, it is having
access to data and then being able to use it in-
telligently,” Herbert states.
Your data is constantly growing and changing.
Now it’s time to see it for all it’s worth.
A report from CIO Market Pulse confirms that data visualization helps
organizations drive discovery and collaboration.
Get the speed of analytics without the wait for IT-generated reports.
Explore billions of rows of data in minutes or seconds, visually presented
in a striking way that brings hidden patterns into plain sight. Then share
real-time insights via the Web or mobile for faster data payoffs.
77%Confirm improved decision
making as a top benefit.
68%
See the potential to collaborate,
report and share information.
VISUAL
ANALYTICS
Plan to use Visual Analytics
in their Big Data strategy.
98%
Each SAS customer’s experience is unique. Actual results vary depending on the customer’s individual conditions. SAS does not guarantee results, and nothing herein should be construed as constituting an additional warranty. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of
SAS Institute Inc. in the USA and other countries. © 2013 SAS Institute Inc.All rights reserved. S109065US.0513
How to Identify Actionable Insights from Big Data
An Interview with Industry Expert Pat Herbert, Principal Solutions Architect, SAS
The goal with big data analysis is to find new
associations between variables, that otherwise
would remain unknown. An example would be
to look at the data collected by a school dis-
trict, transportation department and public
safety data, which all may have data points
that looked at in isolation may seem irrelevant,
but when merged with other variables, new as-
sociations and trends can be found.
Yet, the ability to share data across depart-
ments and agencies remains a challenge at
all levels of government. Herbert states, “Data
infrastructures aren’t typically put together in
a way that permits them to easily share data,
and as a result there is the potential to be able
to have extremely valuable data, but their ex-
ecution ends up locking them out of exercising
their full potential from that data.”
One of the lessons learned that Herbert shared
with GovLoop is the necessity to focus on bal-
ance while implementing a big data program.
Agencies must approach big data with a clear
scope, defined goals and defining what success
looks like. Herbert says he has seen both sides
of the spectrum in adoption, such as agencies
looking to adopt an enterprise wide strategy
right off the bat, and also agencies looking to
adopt smaller, less mission-focused programs.
The key for agencies looking to leverage big
data is finding the right balance and knowing
the appropriate level of investment in a big
data program. Herbert states, “Identify a proj-
ect that may not be the most critical, but is an
important project. Work on that as a complete
initiative, and then expand on that rather than
trying to build out a big data initiative that
covers every single bit of data.” In doing so,
agencies can begin to unlock actionable intel-
ligence from big data.
30.GOVERNMENTBIGDATA29. THEGOVLOOPGUIDE
Using Big Data to
Prevent Waste, Fraud
and Abuse
o witness improved cost savings in
government, there has been an in-
creased interest in using big data
analysis to detect fraud, waste and
abuse. Upon analyzing various data, the Gov-
ernment Accountability Office (GAO) realized
that fragmentation, overlap and duplication
were an issue in government, causing an im-
mense waste of funds. Nikki Clowers, Director
of Financial Markets and Community Invest-
ment Issues at GAO, explained in an interview
with GovLoop’s DorobekInsider the nature of
fragmentation.
“Fragmentation refers to a situation when you
have multiple agencies providing services
in the same broad area. If there is a big issue
facing the nation you can imagine there are
a wide number of agencies that might be in-
volved; but what we find is, fragmentation can
be a harbinger for overlap and duplication
which is a more serious issue.” Fragmentation
can greatly affect the efficiency of agency pro-
grams. Often, information can fall through the
cracks of several programs because of miscom-
munication on which agency is responsible for
what aspects of an issue.
Fragmentation often leads to duplication and
overlap. Duplication, according to Clowers, is
when “the same agencies in the same broad
area provide the same services to the same
beneficiaries.” This is different from overlap,
which is when “you could have multiple agen-
cies in the same area with similar activities but
the beneficiaries might be a little different,”
32.GOVERNMENTBIGDATA31. THEGOVLOOPGUIDE
states Clowers. In the end, both
fragmentation and duplication
lead to a significant waste of
government resources.
Over the years, GAO has re-
searched where duplication
and overlap have occurred in
order to identify those instanc-
es in order to prevent them.
Clowers says, “We [GAO] start
with the budget, and look-
ing at different functions at
the highest level, you can see
where there could be a poten-
tial for overlap. From there we
drill down to the strategic plan
and other agency documents.
We go out and interview offi-
cials. We go on-site to see the
services and activities being
performed.” More often than
not, the cause of the redun-
dancy is missing data, whether
it is lack of budgetary informa-
tion or performance data. That
said, it is important to note that
redundancy can be useful for
agencies, such as Department
of Homeland Security and law
enforcement. However, the
overlaps must be coordinated,
“because if it is not properly
coordinated, that is where we
will get confusion and gaps,”
said Clowers. The take-away
from Clowers and the work at
GAO, in the simplest terms, is
that big data matters.
Additionally, Jennifer Kerber,
President of the TechAmerica
Foundation, spoke on Gov-
Loop’s DorobekInsider, provid-
ing insights to a recent TechA-
merica survey that confirmed
the importance of big data.
“Budgets are tight especially
with the government trying to
cut $85 billion in sequestration
cuts. So I think there is a sig-
nificant focus on how big data
can help reduce waste, fraud
and abuse,” states Kerber.
As previously mentioned, ac-
quiring and using data is one
way to identify and prevent
waste. However, disorganized
data might be more detri-
mental than no data at all. In
an interview with Kerber, she
detailed several three types of
data that could help in saving
money.
1. Controlled Data
In today’s technologically
based world, data is developed
and collected at incredible
rates. While many agencies are
able to collect this data, often
the volume can become cum-
bersome and, therefore, the
data remains unorganized.“We
are just now at a point where
the amount of data that’s com-
ing in and the ability to con-
trol that data is allowing us to
have ‘Smart Data,’” says Kerber.
‘Smart Data,’ or data that is or-
ganized into sets, can prove
to be an excellent resource for
running analytics software to
detect waste or fraud.
2. Real-Time Data
“The ability to do some of this
analysis in real-time allows
you to better deliver services
to customers,” states Kerber,
“Public safety officers can now
use big data to reduce crime
and target criminal hot-spots.
One of the most exciting ar-
eas is health care. You can do
targeted searches in cancer
research for example.” Data
that is no longer relevant can
be dangerous when agencies
depend on it to plan actions
or programs. Accurate data
that is presented in real-time
allows agencies to make quick
decisions based on updated
information.
3. Synthesized Data
No matter how much data is
collected, it is not very useful
if data sets cannot communi-
cate with each other. “Data si-
los are also a big concern,” says
Kerber. It’s important that data
sets from different parts of an
agency are interconnected so
there is not duplication within
an agency. That said, it is also
vital that data from various
agencies across government
can be synthesized in order
to detect overlap and waste
on a larger scale. These efforts
are still being developed, ac-
cording to Kerber: “Right now
a bunch of smart people are
working to make all the data
able to talk to each other.”
With the government facing
tight budgets while promis-
ing to provide transparency, it
cannot be denied that big data
is important. “The potential is
enormous,” Says Kerber, “It’s
evolutionary. It’s almost like
the Internet. These days no-
body asks if you are on the In-
ternet anymore, it’s just a way
of life. Eventually we see that
same evolution in big data.
The data analytics and the de-
cisions behind it will just be-
come a part of life.” The key is
to focus not just on collecting
and using data, but harnessing
the data to turn it into orga-
nized and easily usable infor-
mation that can inform agency
decisions and save hundreds
of millions of dollars.
DOES CONGRESS MANDATE DUPLICATION?
Sometimes Congressional legislation causes duplication. One such instance is with catfish reg-
ulation. “In 2008,” says Clowers, “the Farm Bill gave the responsibility for inspecting catfish to
the USDA, but there were already two other agencies performing that function. We (the GAO)
have recommended that the Congress take those responsibilities away. It is costing the USDA
$14 million annually to regulate the catfish.”
Over the years, GAO has researched where duplication and
overlap have occurred in order to identify those instances
in order to prevent them.
34.GOVERNMENTBIGDATA33. THEGOVLOOPGUIDE
Y O U R B I G D A T A
C H E A T S H E E T
*H A D O O PHadoop is free to use and is a Java-based framework that
supports processing large data sets that are from dispa-
rate servers and hosted in various locations.
*N A T U R A L L A N G U A G E
P R O C E S S I N G ( N L P )
Component of artificial intelligence, allows com-
puters to understand human speech.
*M A C H I N E L E A R N I N G
This is a type of artificial intelligence that allows com-
puters to learn without being programmed – computers
can adapt and grow based on data.
*N O S Q L D A T A B A S E S
“Not Only SQL,” address challenges for big data that re-
lational databases cannot. It’s an approach to database
design for large sets of distributed data, useful for data
stored in the cloud, virtual and unstructured.
*M A P R E D U C E
A two-part process to understand massive amounts
of unstructured data; map: parcels out data, and re-
duce: merges data together, allows programmers to
run programs across multiple machines.
For more definitions, check out some of the fol-
lowing:
Big Data, Bigger Opportunities: Investing in
Information and Analytics (Gartner Report)
Big Data Glossary (O’Reilly Media)
Key big data terms and glossary
There are lots of benefits, but
here are the top 5 benefits to re-
member with big data:
1. Improve efficiencies
2. Improve services
3. Reduce costs
4. Allocate resources more effec-
tively (do more with less)
5. Reveal new insights that other-
wise remain unknown
Why should govern-
ment leverage big
data?
What do I need to
consider?
There are lots of elements to con-
sider and, of course, this cheat
sheet can’t get to them all, but
here is the need-to-know infor-
mation to get a strategic conver-
sation started:
1. Who knows (or can learn) big
data analysis on staff? Do we
have skills in house?
2. How do we collaborate and
what are the core privacy and se-
curity issues?
3. Who creates data and what
kind of format is it in?
4. What are we already doing to
extract value from our data and
how can we improve?
5. What specific problem are we
attempting to solve?
What are some exam-
ples and resources
to reference?
1. Case Study: Boston - Street
Bump
2. Case Study: New York City - The
Mayor’s Greek Squad
3. Case Study: Big Data for Cancer
Care
4. Article: Big Data Revolution,
Changing the Way We Live, Work
and Think
5. Article: Big data: A Big Problem
that’s Getting Bigger
This report provided you with many lessons learned, best practices
and case studies from thought leaders in government and industry
who are leveraging big data to transform government. The following
sections provide you with your big data cheat sheet, a brief sum-
mary of the report and resources for you to find more information
on big data. Big data analysis has the potential to radically transform
how government operates. As we continue to witness an explosion
of data, increasingly agencies need to focus on practices and strate-
gies to extract knowledge and actionable insights.
A L R E A D Y K N O W T H E
N U T S A N D B O L T S O F
B I G D A T A ? L O O K I N G T O
G E T S M A R T Q U I C K O N
B I G D A T A ?
In either case, here is a quick reference
sheet for you to review the need to know
information on big data.
Bit (b)
1 or 0
(short for “binary
digit”, 3 bits is
equal to a single
color pixel)
Byte (B)
8 bits
(any character
on a keyboard
is 1B)
Kilobyte (KB)
1,000B or 2^10 bytes
(kilo = “thousand in
Greek, one page of
typed text is roughly
2KB)
Megabyte (MB)
1,000KB or 2^10 bytes
(The complete work
of Shakespeare is
equivalent to 5MB)
Gigabyte (GB)
1,000MB or 2^30 bytes
(Two-hour film can
be compressed into
1-2 GB)
Terabyte (TB)
1,000GB or 2^40 bytes
(Tera = From monster
in Greek, the entire
Library of Congress,
printed would fill
10TB)
Petabyte (PB)
1,000TB or 2^50 bytes
(It would take 500
million floppy disks to
equal 1PB)
Exabyte (EB)
1,000PB or 2^60 bytes
(It has been said, all
words spoken by
mankind ever (in text)
is around 5EB)
Zettabyte (ZB)
1,000EB or 2^70 bytes
(1 ZB is equal to about
2 billion years worth of
digital music)
Yottabyte (YB)
1,000ZB or 2^80 bytes
(Cool name. Unimagi-
nable amount of data.
The entire World Wide
Web is approaching
1YB )
Visualizing the Size of Data
When someone says we have petabytes of
data? What does that mean? Here’s your
cheat sheet to help you grasp the com-
plexity and size of data.
4 Core Steps for Big Data
Here are four high-level steps for you to always consider
for implementing big data programs:
Learn from
others that are
leveraging big
data successfully
Build a strategic
framework for
harnessing the
potential of big
data
Understand the
human resource
impact
Determine the
types of data
available to you
1 2 3 4
Q
Hello.
36.GOVERNMENTBIGDATA35. THEGOVLOOPGUIDE
his guide provided you with some
best practices, case studies and ex-
pert insights to help you fully lever-
age big data. But, we know that you’re
busy – so just like we gave you a cheat sheet for
big data, here’s everything you need to know
about this guide, based on different settings
you may find yourself in.
1. THE TWITTER VERSION
Reading @GovLoop’s latest report on big data
– handful of case studies and best practices:
bit.ly/117vrGE
2. THE FACEBOOK VERSION
Check out GovLoop’s report on big data – cheat
sheet on big data, dozens of case studies – easy
way to get smart on big data. http://www.gov-
loop.com/profiles/blogs/transforming-your-
agency-with-big-data
3. THE LINKEDIN VERSION
Check out GovLoop’s report on big data – in-
cludes big data survey from GovLoop com-
munity and case studies sharing best practic-
es, lessons learned and overcoming common
challenges for big data initiatives. http://www.
govloop.com/profiles/blogs/transforming-
your-agency-with-big-data
4. HAPPY HOUR SMALL TALK BULLET
POINTS
The data government collects has the pow-
er to change the way government does
business, but government is challenged to
extract knowledge and actionable intelli-
gence.
Philadelphia has implemented dozens of
open data programs including releasing an
Open Data Guidebook.
Mayor Nutter named Mark Headd as Phila-
delphia’s first Chief Data Officer, Headd is
responsible for overseeing open data and
transparency initiatives across Philadelphia.
The Recovery Accountability Transparen-
cy Board (RATB) is leading many big data
programs in the federal government. They
5 N E X T S T E P S &
C O N V E R S A T I O N S T A R T E R S
worked with dozens of agencies to provide
insights on the how stimulus money has
been used to develop Recovery.gov.
IDC has stated that the big data market is
expected to grow from $3.2 billion in 2010
to $16.9 billion in 2015 (Source)
You need special technology to do this (Ma-
pReduce/Hadoop) – but can’t forget about
leadership, vision, culture and workforce
needs
Eric Schmidt stated in 2010 that every two
days we create as much as information as
we did throughout the entire history of civi-
lization up until 2003 (Source).
5. THE BIG DATA 30-SECOND ELEVATOR
PITCH TO YOUR BOSS AND PEERS
Have you had a chance to take a look at Gov-
Loop’s Big Data report? They have a handful
of case studies and best practices, and I think
I got some ideas on how we can start to lever-
age our data. Can we spend a half hour to talk
through? Would love to float some ideas and
see if they can work for our agency.
Big data is changing the way government does
business. Big data is typically defined with
the three V’s: volume, variety and velocity. As
agencies are now collecting data from a vari-
ety of sources (social media, sensors, CRM, and
ERP data), agencies need new and innovative
ways to find insights and leverage the value of
the data they are collecting. There are count-
less examples (see above to fill your pitch with
some great case studies) of leveraging big data
to improve safety, public health and customer
service in government.
38.GOVERNMENTBIGDATA37. THEGOVLOOPGUIDE
A C K N O W L E D G E M E N T S
The GovLoop team is thankful to all of those who contributed to
this report. We thank everyone for their participation in our survey,
active community engagement, input and knowledge shared while
developing this report. Thank you to Bob Gourley for writing the
foreward of this report.
This guide would not have been possibility without your assistance
and from the support of our sponsors, EMC and SAS.
Lead Author:
Patrick Fiorenza, Senior Research Analyst
Co-Author:
Kate Long, GovLoop Spring 2013 Fellow
Editor:
Andrew Krzmarick, Director of Community Engagement
Editor:
Steve Ressler, GovLoop Founder and President
Lead Designer:
Jeff Ribeira, Senior Interactive Designer
Designer:
Russell Yerkes III, GovLoop Summer 2013 Design Fellow
For more information about this report, please contact Patrick Fio-
renza, at pat@govloop.com.
GovLoop’s mission is to connect government to
improve government. We aim to inspire public
sector professionals by acting as the knowl-
edge network for government. The GovLoop
community has over 65,000 members work-
ing to foster collaboration, solve problems and
share resources across government.
The GovLoop community has been widely
recognized across multiple sectors. GovLoop
members come from across the public sector.
Our membership includes federal, state, and
local public servants, industry experts and pro-
fessionals grounded in academic research. To-
day, GovLoop is the leading site for addressing
public sector issues.
A B O U T G O V L O O P
Location
GovLoop is headquartered in Washington D.C.,
with a team of dedicated professionals who
share a commitment to connect and improve
government.
GovLoop
734 15th St NW, Suite 500
Washington, DC 20005
Phone: (202) 407-7421
Fax: (202) 407-7501
GovLoop works with top industry partners to
provide resources and tools to the government
community. GovLoop has developed a variety
of guides, infographics, online training and
educational events, all to help public sector
professionals become more efficient Civil Ser-
vants.
GovLoop’s report, Transforming Your Agency
with Big Data is sponsored by EMC and SAS.
If you have questions on this report, please feel
free to reach out to Patrick Fiorenza, Senior Re-
search Analyst at pat@govloop.com.
39. THEGOVLOOPGUIDE 40.GOVERNMENTBIGDATA
R E S O U R C E S
Big Data Resources for Public Sector Professionals
http://www.govloop.com/big-data
Are Big Data and Cybersecurity a Perfect Match? Emily Jarvis, GovLoop
http://www.govloop.com/profiles/blogs/are-big-data-and-cybersecurity-a-perfect-match
Turning Data in Decisions – Why Metrics Matter. Emily Jarvis, GovLoop
http://www.govloop.com/profiles/blogs/turning-data-into-decisions-why-performance-metrics-matter
Big Data, Big Fear, Big Potential. Danielle Blumenthal
http://www.govloop.com/profiles/blogs/big-data-big-fear-big-potential
Big Data, Social Media and the Long Tail of Public Policy. Nicholas Charney, Posted on GovLoop
http://www.govloop.com/profiles/blogs/big-data-social-media-and-the-long-tail-of-public-policy
Learning from the World Bank’s“Big Data”Exploration Weekend. Dennis McDonald, posted on
GovLoop
http://www.govloop.com/profiles/blogs/learning-from-the-world-bank-s-big-data-exploration-weekend
Transparency Report Card - Did Your State Make the Grade? Emily Jarvis, GovLoop
http://www.govloop.com/profiles/blogs/report-cards-are-in-did-you-state-s-transparency-make-the-grade
Data as Paint, and the Rise of the Data Artist. Bob Gourley, posted on GovLoop
http://www.govloop.com/profiles/blogs/data-as-paint-and-the-rise-of-the-data-artist
Arlington Cemetery Goes Mobile - Take a Look at the New ANC Explorer App. Emily Jarvis, Gov-
Loop
http://www.govloop.com/profiles/blogs/arlington-national-cemetery-goes-digital-take-a-look-at-the-new-a
How Big Data and Location Analytics are Impacting GIS for Government. Pat Fiorenza, GovLoop
http://www.govloop.com/profiles/blogs/how-big-data-and-location-analytics-are-impacting-gis-for-governm
Government Big Data: What’s Next? Experts Give Insight. Bryce Bender, GovLoop
http://www.govloop.com/profiles/blogs/government-big-data-what-s-next-experts-give-insight
Obama Administration Unveils“Big Data”Initiative: Announces $200 Million in New R&D Invest-
ments. Press Release, Office of Science and Technology Policy, Executive Office of the President
http://www.whitehouse.gov/sites/default/files/microsites/ostp/big_data_press_release_final_2.pdf
734 15th St NW, Suite 500
Washington, DC 20005
Phone: (202) 407-7421
Fax: (202) 407-7501

More Related Content

More from GovLoop

Next Gen: Critical Conversations Slide Deck
Next Gen: Critical Conversations Slide DeckNext Gen: Critical Conversations Slide Deck
Next Gen: Critical Conversations Slide DeckGovLoop
 
Internet of Things: Lightning Round, Sargent
Internet of Things: Lightning Round, SargentInternet of Things: Lightning Round, Sargent
Internet of Things: Lightning Round, SargentGovLoop
 
Internet of Things: Lightning Round, Ronzio
Internet of Things: Lightning Round, RonzioInternet of Things: Lightning Round, Ronzio
Internet of Things: Lightning Round, RonzioGovLoop
 
Internet of Things: Lightning Round, Hite
Internet of Things: Lightning Round, HiteInternet of Things: Lightning Round, Hite
Internet of Things: Lightning Round, HiteGovLoop
 
Internet of Things: Lightning Round, Fritzinger
Internet of Things: Lightning Round, FritzingerInternet of Things: Lightning Round, Fritzinger
Internet of Things: Lightning Round, FritzingerGovLoop
 
Internet of Things: Lightning Round, McKinney
Internet of Things: Lightning Round, McKinneyInternet of Things: Lightning Round, McKinney
Internet of Things: Lightning Round, McKinneyGovLoop
 
Internet of Things: Government Keynote, Randy Garrett
Internet of Things: Government Keynote, Randy GarrettInternet of Things: Government Keynote, Randy Garrett
Internet of Things: Government Keynote, Randy GarrettGovLoop
 
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722GovLoop
 
Week Three
Week ThreeWeek Three
Week ThreeGovLoop
 
FHWA Week Two
FHWA Week TwoFHWA Week Two
FHWA Week TwoGovLoop
 
Building Powerful Outreach - Executive Research Brief
Building Powerful Outreach - Executive Research BriefBuilding Powerful Outreach - Executive Research Brief
Building Powerful Outreach - Executive Research BriefGovLoop
 
Turning Big Data into Big Decisions
Turning Big Data into Big DecisionsTurning Big Data into Big Decisions
Turning Big Data into Big DecisionsGovLoop
 
Examining the Big Data Frontier
Examining the Big Data FrontierExamining the Big Data Frontier
Examining the Big Data FrontierGovLoop
 
The Need for NoSQL - MarkLogic
The Need for NoSQL - MarkLogicThe Need for NoSQL - MarkLogic
The Need for NoSQL - MarkLogicGovLoop
 
Capitalizing on the Cloud
Capitalizing on the CloudCapitalizing on the Cloud
Capitalizing on the CloudGovLoop
 
Build Better Virtual Events & Training for your Agency
Build Better Virtual Events & Training for your AgencyBuild Better Virtual Events & Training for your Agency
Build Better Virtual Events & Training for your AgencyGovLoop
 
Social Media Presentation for The Center for Organizational Effectiveness
Social Media Presentation for The Center for Organizational EffectivenessSocial Media Presentation for The Center for Organizational Effectiveness
Social Media Presentation for The Center for Organizational EffectivenessGovLoop
 
Guide to Managing the Presidential Management Fellows (PMF) Application Proce...
Guide to Managing the Presidential Management Fellows (PMF) Application Proce...Guide to Managing the Presidential Management Fellows (PMF) Application Proce...
Guide to Managing the Presidential Management Fellows (PMF) Application Proce...GovLoop
 
Winning the Cybersecurity Battle
Winning the Cybersecurity BattleWinning the Cybersecurity Battle
Winning the Cybersecurity BattleGovLoop
 
Leadership is Passion to Improve Our World
Leadership is Passion to Improve Our WorldLeadership is Passion to Improve Our World
Leadership is Passion to Improve Our WorldGovLoop
 

More from GovLoop (20)

Next Gen: Critical Conversations Slide Deck
Next Gen: Critical Conversations Slide DeckNext Gen: Critical Conversations Slide Deck
Next Gen: Critical Conversations Slide Deck
 
Internet of Things: Lightning Round, Sargent
Internet of Things: Lightning Round, SargentInternet of Things: Lightning Round, Sargent
Internet of Things: Lightning Round, Sargent
 
Internet of Things: Lightning Round, Ronzio
Internet of Things: Lightning Round, RonzioInternet of Things: Lightning Round, Ronzio
Internet of Things: Lightning Round, Ronzio
 
Internet of Things: Lightning Round, Hite
Internet of Things: Lightning Round, HiteInternet of Things: Lightning Round, Hite
Internet of Things: Lightning Round, Hite
 
Internet of Things: Lightning Round, Fritzinger
Internet of Things: Lightning Round, FritzingerInternet of Things: Lightning Round, Fritzinger
Internet of Things: Lightning Round, Fritzinger
 
Internet of Things: Lightning Round, McKinney
Internet of Things: Lightning Round, McKinneyInternet of Things: Lightning Round, McKinney
Internet of Things: Lightning Round, McKinney
 
Internet of Things: Government Keynote, Randy Garrett
Internet of Things: Government Keynote, Randy GarrettInternet of Things: Government Keynote, Randy Garrett
Internet of Things: Government Keynote, Randy Garrett
 
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
 
Week Three
Week ThreeWeek Three
Week Three
 
FHWA Week Two
FHWA Week TwoFHWA Week Two
FHWA Week Two
 
Building Powerful Outreach - Executive Research Brief
Building Powerful Outreach - Executive Research BriefBuilding Powerful Outreach - Executive Research Brief
Building Powerful Outreach - Executive Research Brief
 
Turning Big Data into Big Decisions
Turning Big Data into Big DecisionsTurning Big Data into Big Decisions
Turning Big Data into Big Decisions
 
Examining the Big Data Frontier
Examining the Big Data FrontierExamining the Big Data Frontier
Examining the Big Data Frontier
 
The Need for NoSQL - MarkLogic
The Need for NoSQL - MarkLogicThe Need for NoSQL - MarkLogic
The Need for NoSQL - MarkLogic
 
Capitalizing on the Cloud
Capitalizing on the CloudCapitalizing on the Cloud
Capitalizing on the Cloud
 
Build Better Virtual Events & Training for your Agency
Build Better Virtual Events & Training for your AgencyBuild Better Virtual Events & Training for your Agency
Build Better Virtual Events & Training for your Agency
 
Social Media Presentation for The Center for Organizational Effectiveness
Social Media Presentation for The Center for Organizational EffectivenessSocial Media Presentation for The Center for Organizational Effectiveness
Social Media Presentation for The Center for Organizational Effectiveness
 
Guide to Managing the Presidential Management Fellows (PMF) Application Proce...
Guide to Managing the Presidential Management Fellows (PMF) Application Proce...Guide to Managing the Presidential Management Fellows (PMF) Application Proce...
Guide to Managing the Presidential Management Fellows (PMF) Application Proce...
 
Winning the Cybersecurity Battle
Winning the Cybersecurity BattleWinning the Cybersecurity Battle
Winning the Cybersecurity Battle
 
Leadership is Passion to Improve Our World
Leadership is Passion to Improve Our WorldLeadership is Passion to Improve Our World
Leadership is Passion to Improve Our World
 

Recently uploaded

办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一
办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一
办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一A SSS
 
Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607
Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607
Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607dollysharma2066
 
The Next Things To Immediately Do About Mating Press
The Next Things To Immediately Do About Mating PressThe Next Things To Immediately Do About Mating Press
The Next Things To Immediately Do About Mating Pressmatingpress170
 
原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证
原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证
原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证diploma001
 
定制英国克兰菲尔德大学毕业证成绩单原版一比一
定制英国克兰菲尔德大学毕业证成绩单原版一比一定制英国克兰菲尔德大学毕业证成绩单原版一比一
定制英国克兰菲尔德大学毕业证成绩单原版一比一z zzz
 
Digital Marketing Training Institute in Mohali, India
Digital Marketing Training Institute in Mohali, IndiaDigital Marketing Training Institute in Mohali, India
Digital Marketing Training Institute in Mohali, IndiaDigital Discovery Institute
 
办理老道明大学毕业证成绩单|购买美国ODU文凭证书
办理老道明大学毕业证成绩单|购买美国ODU文凭证书办理老道明大学毕业证成绩单|购买美国ODU文凭证书
办理老道明大学毕业证成绩单|购买美国ODU文凭证书saphesg8
 
原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量sehgh15heh
 
LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024Bruce Bennett
 
办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改
办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改
办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改yuu sss
 
办理哈珀亚当斯大学学院毕业证书文凭学位证书
办理哈珀亚当斯大学学院毕业证书文凭学位证书办理哈珀亚当斯大学学院毕业证书文凭学位证书
办理哈珀亚当斯大学学院毕业证书文凭学位证书saphesg8
 
美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作ss846v0c
 
Application deck- Cyril Caudroy-2024.pdf
Application deck- Cyril Caudroy-2024.pdfApplication deck- Cyril Caudroy-2024.pdf
Application deck- Cyril Caudroy-2024.pdfCyril CAUDROY
 
Crack JAG. Guidance program for entry to JAG Dept. & SSB interview
Crack JAG. Guidance program for entry to JAG Dept. & SSB interviewCrack JAG. Guidance program for entry to JAG Dept. & SSB interview
Crack JAG. Guidance program for entry to JAG Dept. & SSB interviewNilendra Kumar
 
LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024Bruce Bennett
 
定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一
定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一
定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一z xss
 
Protection of Children in context of IHL and Counter Terrorism
Protection of Children in context of IHL and  Counter TerrorismProtection of Children in context of IHL and  Counter Terrorism
Protection of Children in context of IHL and Counter TerrorismNilendra Kumar
 
办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一
办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一
办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一A SSS
 
格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档
格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档
格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档208367051
 
Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...
Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...
Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...nitagrag2
 

Recently uploaded (20)

办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一
办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一
办理学位证(Massey证书)新西兰梅西大学毕业证成绩单原版一比一
 
Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607
Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607
Gurgaon Call Girls: Free Delivery 24x7 at Your Doorstep G.G.N = 8377087607
 
The Next Things To Immediately Do About Mating Press
The Next Things To Immediately Do About Mating PressThe Next Things To Immediately Do About Mating Press
The Next Things To Immediately Do About Mating Press
 
原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证
原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证
原版定制卡尔加里大学毕业证(UC毕业证)留信学历认证
 
定制英国克兰菲尔德大学毕业证成绩单原版一比一
定制英国克兰菲尔德大学毕业证成绩单原版一比一定制英国克兰菲尔德大学毕业证成绩单原版一比一
定制英国克兰菲尔德大学毕业证成绩单原版一比一
 
Digital Marketing Training Institute in Mohali, India
Digital Marketing Training Institute in Mohali, IndiaDigital Marketing Training Institute in Mohali, India
Digital Marketing Training Institute in Mohali, India
 
办理老道明大学毕业证成绩单|购买美国ODU文凭证书
办理老道明大学毕业证成绩单|购买美国ODU文凭证书办理老道明大学毕业证成绩单|购买美国ODU文凭证书
办理老道明大学毕业证成绩单|购买美国ODU文凭证书
 
原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量
原版定制copy澳洲查尔斯达尔文大学毕业证CDU毕业证成绩单留信学历认证保障质量
 
LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024
 
办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改
办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改
办澳洲詹姆斯库克大学毕业证成绩单pdf电子版制作修改
 
办理哈珀亚当斯大学学院毕业证书文凭学位证书
办理哈珀亚当斯大学学院毕业证书文凭学位证书办理哈珀亚当斯大学学院毕业证书文凭学位证书
办理哈珀亚当斯大学学院毕业证书文凭学位证书
 
美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作
 
Application deck- Cyril Caudroy-2024.pdf
Application deck- Cyril Caudroy-2024.pdfApplication deck- Cyril Caudroy-2024.pdf
Application deck- Cyril Caudroy-2024.pdf
 
Crack JAG. Guidance program for entry to JAG Dept. & SSB interview
Crack JAG. Guidance program for entry to JAG Dept. & SSB interviewCrack JAG. Guidance program for entry to JAG Dept. & SSB interview
Crack JAG. Guidance program for entry to JAG Dept. & SSB interview
 
LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024
 
定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一
定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一
定制(SCU毕业证书)南十字星大学毕业证成绩单原版一比一
 
Protection of Children in context of IHL and Counter Terrorism
Protection of Children in context of IHL and  Counter TerrorismProtection of Children in context of IHL and  Counter Terrorism
Protection of Children in context of IHL and Counter Terrorism
 
办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一
办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一
办理学位证(UoM证书)北安普顿大学毕业证成绩单原版一比一
 
格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档
格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档
格里菲斯大学毕业证(Griffith毕业证)#文凭成绩单#真实留信学历认证永久存档
 
Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...
Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...
Escorts Service Near Surya International Hotel, New Delhi |9873777170| Find H...
 

Transforming Your Agency With Big Data

  • 2. 2.GOVERNMENTBIGDATA1. THEGOVLOOPGUIDE W E L C O M E / C O N T E N T S ForEward: Bob Gourley, Founder, CTOVISION - - - - - - - - - - - - - - - - - 3 Executive Summary - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 5 The State of Big Data: Highlights from the GovLoop Survey - - - 8 Figure 1: Big Data Impact on Mission Areas 9 Figure 2: Where Does Your Agency Data Come From? 9 Figure 3: Who Creates Your Agency’s Data? 10 Figure 4: What has been the core driver for big data initiatives? 10 Leading the Way: Big Data Lessons from Philadelphia - - - - - 14 Expert Insights with Mark Headd, Chief Data Office, City of Philadelphia 14 Challenges to Adopting Big Data at the City of Philadelphia 15 From the GovLoop Survey: Challenges to Implementing Big Data Initiatives 17 Best Practices to Implementing Big Data Initiatives 16 5 Steps to Leverage Big Data in Your Agency - - - - - - - - 20 Expert Insights with Shawn Kingsberry, Chief Information Officer, Recovery Accountability and Transparency Board (RATB) 20 1. Identify a Clear Business Need or Problem 22 2. Identify Risks and Issues 22 3. Craft a Clear Vision 23 4. Identify Resource Needs 23 5. Enable and Optimize Services 24 Achieving Workforce Efficiencies with Big Data - - - - - - - - - 25 An interview with industry expert, Audie Hittle, Chief Technology Officer (CTO) Federal Market at EMC Isilon. 25 How to Identify Actionable Insights from Big Data - - - - - - - - - 27 An Interview with Industry Expert, Pat Herbert, Principal Solutions Architect, SAS 27 Using Big Data to Prevent Waste, Fraud and Abuse - - - - - - - - 30 Controlled Data 32 Real-Time Data 32 Synthesized Data 32 Does Congress Mandate Duplication? 32 Guide Synopsis and Big Data Resources - - - - - - - - - - - - - - - 33 Your Big Data Cheat Sheet 33 5 Next Steps and Conversation Starters 35 Acknowledgements - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 37 About GovLoop - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 38 Resources - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 39
  • 3. 4.GOVERNMENTBIGDATA3. THEGOVLOOPGUIDE overnment technology decision makers in all three branches of federal government and from many States consistently tell me about an issue they have with “Big Data”. This is an issue you have seen too I’m sure. The is- sue is a lack of discipline and rigor over the use of the term itself. What began as a concept describing a specific set of new capabili- ties to enable analysis that could never be done before has become a movement where every strategist, marketer and pundit seeks to offer their own definition and use of the term. That is why I was so happy to see GovLoop’s mission-focused approach to this issue. By focusing on the missions of enterprises and then surveying real de- cision-makers for issues they are helping bring discipline and focus to the domain. Why is discipline important at this stage? Do you remember service- oriented architecture (SOA)? This concept led to tremendous new capabilities and efficient, mission-focused designs. Enterprises es- tablished architectures in which application interfaces, logic and data were separated and smartly reusable. After the term went mainstream, every company in the IT ecosystem grabbed onto it and began to use the acronym SOA to mean anything they wanted it to. Although it’s still a useful construct for IT professionals, when it comes to interacting with industry, the term has now lost much of its meaning. If we let the term “Big Data”go the way of “SOA”we will sub-optimize its use. If we keep a mission-focused discipline on the term we will F O R E W A R D help drive continuing improvement and optimize the insertion of new innovative technologies into governments. As you dive into this report keep the following definition of Big Data in mind. It flows from Doug Laney’s famous articulation of the“Three V’s” and is consistent with the collaborative efforts of the TechAmer- ica foundation and with our reporting at CTOvision.com and with the community edited WikiPedia entry for Big Data: Big Data: A phenomenon defined by the rapid acceleration in the expanding volume of high velocity, complex and diverse types of data. Big Data is often defined along three dimensions– volume, velocity and variety. Big Data Solutions: Advanced techniques and technologies to enable the capture, storage, distribution, management and anal- ysis of information. A Big Data solution uses new approaches for sense-making over large quantities of data, such as in the Apache Hadoop Big Data Platform. Please keep these terms in mind as you review this Govloop guide to Transforming Your Agency with Big Data. The insights you find here will help you learn from others who are also on the journey and will also help you speed along the Big Data projects you may already have underway. Bob Gourley http://ctovision.com http://crucialpointllc.com bob@crucialpointllc.com 703 994 0549
  • 4. 6.GOVERNMENTBIGDATA5. THEGOVLOOPGUIDE he way agencies store, manage and collect data is changing. In the past, agencies analyzed data from stable enterprise services. Data was created from customer relationship management ser- vices, enterprise resource planning systems or from the variety of financial instruments agen- cies used to process transactions. Agencies could then run common reports, store data in warehouses or databases, and easily extract knowledge to inform their decision-making. With the explosion of data from social media, the Internet and growing examples of online transactions, government has more opportu- nities than ever before to transform agencies through big data analysis. Through qualitative and quantitative analysis, this report will highlight the common chal- lenges, best practices and pertinent issues sur- rounding big data. Transforming Your Agency Through Big Data includes a survey from 215 public sector professionals, and interviews with government and industry thought lead- ers. Expert interviews include: Nikki Clowers, Director of Financial Markets and Community Investment Issues at GAO Mark Headd, Chief Data Officer, City of Philadel- phia Audie Hittle, Chief Technology Officer (CTO), Fed- eral Market at EMC Isilon Jennifer Kerber, President of the TechAmerica Foundation Shawn Kingsberry, Chief Information Officer, Re- covery Accountability and Transparency Board (RATB) Pat Herbert, Principal Solutions Architect, SAS E X E C U T I V E S U M M A R Y Our report identifies that government agen- cies are still at the early stages of adopting big data initiatives. To fully leverage big data analysis, agencies are in need of guidance and best practices to fully capitalize on the data that they are collecting. In our survey, GovLoop found that education (19%), acquiring infra- structure (18%), and confidentiality and access control (16%) were some of the challenges fac- ing government. Additional findings highlight the ways govern- ment has leveraged big data. The survey finds that budget/finance (14%), communications/ public affairs (14%) and health and human ser- vices (11%) were the leading mission areas in which organizations have leveraged big data analysis. Additionally, the survey finds that the majority of organizations have yet to hire a data scientist, as 61% of respondents do not have data scientist on staff. To begin to craft big data strategies, GovLoop believes that agencies should: 1. Consider parallels and lessons learned from existing open data initiatives. 2. Identify resource needs and staffing. 3. Be strategic and develop clear vision statement and goals. 4. Work diligently to extract knowledge from legacy systems and unstructured data. 5. Government to government collabora- tion is essential, agencies need to focus on standardizing data and developing shared infrastructures. This report concludes with a big data cheat sheet, as a means to quickly get the ‘need to know’ facts on big data and a brief outline of the key findings in this report. As budgets continue to plague the public sector, agencies are searching for new efficiencies and innova- tive ways to find actionable insights from big data analysis. This report can serve as the first step for your agency to harness the power of data, and improve decision-making, informa- tion sharing and service delivery of the agency through data analysis. With the explosion of data from social media, the Internet and growing examples of online transactions, government has more opportunities than ever before to transform agencies through big data analysis.
  • 5. 8.GOVERNMENTBIGDATA7. THEGOVLOOPGUIDE ecently, GovLoop conducted a sur- vey on big data applications across government. The survey included 215 responses primarily from a fed- eral audience (41%), and also in- cluded participants from state level employees (24%), local government (23%) and contribu- tions from academia and industry members (12%). Throughout this report, GovLoop shares additional findings from our survey. One question explored,“Do you or your organi- zation use big data in a way that has an impact on any of the following mission areas?” Re- spondents could choose from acquisition/con- tracting, budgeting/finance, communications/ public affairs, economic development, emer- gency management, environmental protec- tion, health and human services, parks and rec- reation, public works, property management and transportion. The results can be found in Figure 1. Respondents indicated the top three results for big data applications were for bud- geting/finance (14%), communications/public affairs (14%), and health and human services (11%). Respondents also had the chance to submit other ways they are leveraging big data analysis on mission areas, participants identi- The State of Big Data H i g h l i g h t s f r o m t h e G o v L o o p S u r v e y
  • 6. 10.GOVERNMENTBIGDATA9. THEGOVLOOPGUIDE fied areas such as performance measurement, security and defense and education and skill development. Kimberly Denz, Business Sys- tems Analyst, Mississippi De- partment of Marine Resources, provided some ways that big data is starting to be lever- aged by the State of Mississip- pi for mission centric activities. Denz provided the example of monitoring coastal ecol- ogy and tracking compliance. Denz states that it is difficult to know if the agency is out of compliance because of how many permits have been is- sued, which can be capped to preserve coastal plains and the environment. Another scenar- io Denz identifies is leveraging existing data across agencies. The scenario she provides is imagining if the Mississippi Marine Patrol cites an indi- vidual for a violation, they can then check and know if the in- dividual is wanted by the FBI, and proceed appropriately. Additional questions explored where agency data came from (Figure 2), and who creates agency data (Figure 3). The survey shows that the leading way respondents collect data is through capturing informa- tion from documents, whether they are print or digital. Clear- ly, with the growth of self ser- vice platforms, and increasing examples of transactions per- formed online, government is flooded with documents, and they serve as one of the prima- ry sources of data for organiza- tions. Additionally, web data and email both were in the top three for data sources. As more services move to the web, these findings are consis- tent with the emerging ways constituents engage with gov- ernment. Respondents stated Where Does Your Agency Data Come From? (Figure 2) Big Data Impact on Mission Areas (Figure 1) Do you or your organization use big data in a way that has an impact on any of the fol- lowing mission areas? (Please select all that apply) that data is created through direct collection strategies, en- vironmental monitoring and research, licensing and geo- spatial information systems (GIS). Figure 3, which highlights data creators, shows that most of the data created by govern- ment is from internal stake- holders, as in employees, from internal processes or through various inter-governmental collaborations. Some of the key results from figures 3 and 4 are: Data that government col- lects is varied Need to find insights from multiple sources of data Standardization continues to be a challenge Legacy systems make it challenging to access his- torical data Acquisition/C ontracting Budgeting/Finance C om m unications/ Public Affairs Econom ic D evelopm ent Em ergency M anagem ent/ Fire/Police Environm ental Protection/Services H ealth and/or H um an Services Parksand Recreation Public W orks Property M anagem entTransportation 4% 8% 14% 14% 9%8%8% 11% 6% 8% 5% C ustom er Relationship M anagem ent(C RM )System s TransactionalEnterprise Resource Planning (ERP)data SocialM edia/ SocialD ata M achine-generated/ sensor data M etadata Em ail 14% 19% 10% 10%9% 11% 11% 8% D ocum ents W eb data
  • 7. 12.GOVERNMENTBIGDATA11. THEGOVLOOPGUIDE The survey also explores what the core drivers for big data adoption has been. Our survey finds that the main reason gov- ernment is adopting big data initiatives is due to increasing needs to find efficiencies in government. Following effi- ciencies is the desire to opti- mize services based on trends. Clearly, government organi- zations are looking to use big data to improve the service delivery for citizens, and iden- tify new and emerging ways to optimize and streamline pro- cesses. Survey respondents mentioned, they have adopted big data programs for “holistic perspective of complex issues,” and “Support of increased ana- lytical capabilities by organiza- tion.” The GovLoop survey provided a snapshot of how agencies are planning to use, or how they are using big data analysis. In many cases, this is uncharted territory for government agen- cies. In the following sections of this report, GovLoop spoke with government and indus- try leaders who are leading the way with big data analysis. Through their expert insights, government agencies can learn the best practices and craft strategies to help trans- form their agency through big data. Who Creates Your Agency’s Data?(Figure 3) What has been the core driver for big data initiatives? (Figure 4) 27% Citizens Internal processes Public information Staff Collaborate with other agencies 13% 24% 14% 19% Cost Savings Efficiencies Demands for service upgrades by customers Deciphering waste, fraud and abuse Optimize services based on trends Support of big data initiatives by senior leadership 9% 9% 10% 13% 23% 26%
  • 8. 14.GOVERNMENTBIGDATA13. THEGOVLOOPGUIDE EXPERT INSIGHTS WITH MARK HEADD, CHIEF DATA OFFICER, CITY OF PHILADELPHIA n August 2012, Philadelphia Mayor Mi- chael Nutter named Mark Headd as the City’s first Chief Data Officer. In this role, Headd is responsible for overseeing open data and transparency initiatives across Philadelphia. In this report, Headd provides his expert insights on how municipal govern- ments can leverage big data, the relationship between big data and open data, and identi- fies lessons learned and insights for agencies to craft big data strategies. The City of Philadelphia is still exploring how to effectively leverage big data to improve citywide operations. Headd notes that the city has started several pilot programs that com- bine city data with data obtained from various social networks and internal resources. Headd states, “Along with most cities, we are very much at the very beginning stages of adopt- ing big data programs.” In many cases, big data programs are still in their nascent stages, and this section of the report highlights Headd’s expert insights on how to leverage data to im- prove public sector decision-making. Headd defines big data as, “the extraction of big ideas from data, regardless of the size of data.” For the City of Philadelphia, big data is not as much about specialized technology, such as Hadoop and MapReduce, as it is about collaboration and extracting meaningful in- formation from data across agencies and de- partments. “Big data is less about the size of Leading the Way B i g D a t a L e s s o n s f r o m P h i l a d e l p h i a
  • 9. 16.GOVERNMENTBIGDATA15. THEGOVLOOPGUIDE big data and more about the extraction of actionable intel- ligence of data,” stated Headd. Headd continues to describe the difference between federal and local applications of big data: “Philadelphia does not have petabytes of data, we are not the census bureau, we are not the federal government, at a municipal government scale, and even at the state level, it’s less about specialized tech- nology, and its more about data across departments and across agencies.” Although Headd identifies that Philadel- phia is not collecting the same volume of data as the federal government, across all levels of government, agencies are challenged to break down si- loes and work collaboratively to share data, which can pro- vide leaders with new insights and improved decision-mak- ing. Challenges to Adopting Big Data at the City of Philadelphia As the City of Philadelphia be- gan to explore big data initia- tives, the city faced two core challenges, extracting knowl- edge from legacy systems and a fragmented style of gover- nance. ment decisions were made. The challenge with legacy sys- tems is that they make it chal- lenging on a enterprise wide scale to: Extract data Share data Combine data Analyze date “The problem is that the tools for using data have devel- oped so quickly and become so powerful that they really highlight the fact that when IT investment decisions were made, they often were made without the foresight that someday ‘we’d want to do dif- ferent things with this data,’ and I don’t think that is unusu- al across government,” states Headd. CHALLENGE 2: SHARING DATA WITHIN A FRAGMENTED GOVERNMENT STRUCTURE Typically, a fragmented gov- ernment is used to describe the relationship between county and city government – with no central authority. Here we are using the term ‘fragmented’ to describe the multiple agencies and actors involved with data collection and service delivery within the City of Philadelphia. Within the City there are mul- tiple government entities serv- ing the needs of citizens. For instance, to name a few: CHALLENGE 1: EXTRACTING KNOWLEDGE FROM OUTDATED LEGACY SYSTEMS A legacy system is simply an antiquated technology or ap- plication that government uses. In many cases, outdated technology makes it very chal- Transportation authority that runs trains, buses and the subway School district that oper- ates independently from the City of Philadelphia Separate parking author- ity that operates street and lot parking throughout the city Public safety programs lenging for organizations to extract data and identify value. As Headd states,“people didn’t even know what would be pos- sible with modern systems. We simply didn’t know what we didn’t know.” Headd identified that many of the technologies available today were not on anyone’s radar when invest- This means that there is sub- stantial overlap of services by government agencies, creat- ing multiple data sets. “Data often within the same govern- ment is often dispersed, and data is in different formats, in different systems and siloed,” states Headd. For Headd, a core challenge is to combine data sets, bring in additional data, such as social media, and then work to extract action- able intelligence from data. “The problem is that the tools for using data have devel- oped so quickly and become so powerful that they really highlight the fact that when IT investment decisions were made, they often were made without the foresight that someday ‘we’d want to do dif- ferent things with this data,’ and I don’t think that is un- usual across government” - Mark Headd, Chief Data Officer, City of Philadelphia From the GovLoop Survey: Challenges to Implementing Big Data Initiatives (Figure 5) Our survey explored challenges to big data. The data in Figure 5 shows that agencies are faced with a myriad of challenges on adopting big data, and still in the early stages of big data adoption, learning and working through challenges to many challenges to implement big data programs. Acquiring infrastructure Education Leadership Data privacy Cyber security Confidentiality and access control 19% 18% 16% 15% 13% 13%
  • 10. 18.GOVERNMENTBIGDATA17. THEGOVLOOPGUIDE erational side of government,” states Headd. Open data and big data have a lot of parallels. In both cases, agencies are forced to think about how to leverage data to serve the most critical func- tions. Along the way, agencies must consider security impli- cations, work with customers to meet needs (could be a citi- zen or an agency), and clearly identify success metrics. 3 STEPS TO LEVERAGE OPEN DATA TO IMPROVE BIG DATA PROGRAMS 1. Open data and big data have parallels to adoption 2. Process to open data to external clients is similar to leveraging data internally 3. Focus on the process and think strategically on data usage “When agencies go through the process of opening data up for public consumption agencies have to go through a lot of the same steps that they would need to go through to share data internally, so it re- ally sort of changes the way people think about data,” states Mark Headd, Chief Data Officer, City of Philadelphia BUILD INFRASTRUCTURES THAT SCALE AND ARE EASILY SHARED Headd noted that agencies did not prepare for future needs while making IT investments, which hindered the ability to extract knowledge from legacy systems. Headd states, “Hope- fully these lessons will allow us to make smarter investment decisions in the future.” To work around old legacy sys- tems, Headd and his team are re-engineering infrastructure to rethink and redefine the way the city shares data between agencies and departments. In doing so, Philadelphia can more efficiently use data to inform operational decisions and focus on cloud computing and data storage offerings that easily scale to meet demands. With increasing volumes of data, Philadelphia has learned that the ability to scale servic- es is essential to meeting the needs of government agen- cies. Yet a scalable infrastructure is only half the equation. Agen- cies must also focus on share- able infrastructures, thinking of new and innovative ways agencies can access data and information across the entire enterprise. This will help to avoid the fragmented nature of data, siloes and facilitate improved information sharing. Headd states, “Philadelphia does not have data that is just big, but we have big problems. The key to getting at those problems will be creating a shareable infrastructure.” Le- veraging big data will contin- ue to be essential in facilitat- ing improved decision making for the public sector. Headd’s insights provide a sol- id foundation for agencies to build their big data initiatives. As the public sector contin- ues to develop more kinds of data, and the need for thor- ough data analysis continues to grow in importance, identi- fying strategies and best prac- tices for big data programs is essential. Philadelphia is one of many cities starting to lever- age data in new and emerging ways, which is transforming the way government operates and modernizing agencies. was the relationship between open data and big data, and from Headd’s perspective, how open data initiatives can lead organizations to develop big data programs. Additionally, Headd asserts the importance of scaling services and offer- ings to meet future demand. CONSIDER LESSONS FROM OPEN DATA INITIATIVES During the interview, Headd explored how big data dif- fers from open data. Headd’s insights show that both are interconnected, but serve a different mission need for gov- ernment agencies. While open data is used for outside con- sumers to make informed data based decisions, big data is used for organizations to make decisions at the enterprise lev- el. For instance, an open data initiative may allow citizens to report potholes for the city transportation to fix, while a big data initiative may iden- tify traffic patterns to learn what areas of the community need to be allocated funding to upgrade roads and infra- structure. Open data focuses on the government-to-citizen relationships, while big data focuses on government-to- government relationships. Headd provides more clarity on the distinction between big data and open data: “Big data is more about organizations using data to inform their own decisions, where as open data is more about giving the pub- lic, outside consumers data to inform what they do, decisions they make.” Although big data and open data are slightly different, Headd recommends prior to starting a big data initiative, agencies should explore open data programs. “I always de- scribe open data as the gate- way drug to big data, because it makes government think about there data differently, open data makes government think more strategically about their data, it makes them think about the share-ability of data, which is one of the big hin- drances to using big data and to using data to inform better decision making on the op- This is an enormous task for the City of Philadelphia, but is a core requirement for the city to advance big data pro- grams. Headd is working to create a “shareable infrastruc- ture,” where agencies can eas- ily access and leverage data citywide. This will be essential to capitalizing on the various kinds of data that the city col- lects, identifying new insights and improving the operations of government. Best Practices to Implementing Big Data Initiatives Although big data is just be- ginning in the City of Phila- delphia, Headd provides his thoughts on what agencies can do to leverage big data programs. Like with most IT investments, one of the first steps is to clearly state the business problem, and how a robust use of big data will help achieve the organiza- tion’s end goals. One of the in- teresting insights from Headd 3 INFRASTRUCTURE NEEDS FOR BIG DATA 1. Scalable offerings to meet increasing demands from stakeholders 2. Shareable infrastructure to facilitate collaboration across departments 3. Re-engineer systems to upgrade legacy systems to access historical data For the City of Philadelphia, big data is not as much about specialized technology, such as Hadoop and MapReduce, as it is about collaboration and extracting meaningful infor- mation from data across agencies and departments.
  • 11. 20.GOVERNMENTBIGDATA19. THEGOVLOOPGUIDE Expert Insights with Shawn Kingsberry, Chief Information Officer, Recovery Accountability and Transparency Board (RATB) n an interview for this report, Shawn Kingsberry, Chief Information Officer, Re- covery Accountability and Transparency Board (RATB), highlighted some of the innovative practices he is leading surround- ing big data and emerging technology. Kings- berry’s comments highlight the importance of leveraging big data in government, and how big data can facilitate new insights and stream- line efficiencies for federal agencies. Currently, agencies are looking to data as a means to dis- cover innovative solutions to complex public sector challenges. This section will highlight Kingsberry’s work at the RATB, and five steps to leverage big data within a federal agency. The Recovery Accountability and Transparency Board (RATB) is an independent agency within the federal government. This places the RATB in a unique position of being a government agency that is independent of political agenda and partisan politics. RATB’s mission is to pro- vide extensive transparency insights to federal programs as well as prevent waste, fraud and abuse related to how Recovery Act funds are spent. Recovery.gov, one of RATB’s transpar- ency websites, provide the opportunity for the public to explore recovery funds within their community. Citizens can visit the site to look at maps that provide an overview of where 5 Steps to Leverage Big Data in Your Agency
  • 12. 22.GOVERNMENTBIGDATA21. THEGOVLOOPGUIDE Recovery Funds are going, or to research the way funds are used by entering their zip code. Additionally, constitu- ents can even report instanc- es of fraud, waste, apply for grants, and even share the raw or visualized data, which cre- ates improved transparency and involvement in govern- ment activities by citizens. Big data is more than the col- lection and storage of exten- sive volumes of data. Agen- cies need to leverage data to improve services and to do so, data must be organized and structured so information can be digested and used to reach agency goals. However, with the lack of standardization of data between agencies and the absence of established data communications be- tween agencies, sharing and using data to optimize trans- parency and agency objec- tives across government has become a daunting task for organizations. “From the fed- eral standpoint, we have a lot of work to do,” states Kingsber- ry, especially as the amount of data developed every month has grown exponentially and is predicted to keep growing at an astounding rate. Kings- berry states: “When you look at the expect- ed amount of data that’s going to be transferred per month externally across the web, the expectation is that by 2021 we’re going to be looking at 180,000 petabytes per month. If you go all the way back to the other side of the spectrum, in 1990 we were under 20,000 petabytes per month. That gives you the growth of tech- nologies that have been com- ing online that enable custom- ers, citizens, and government to be more connected,” With increasing volumes of data, government agencies, such as the Recovery Ac- countability and Transparency Board, must put a focus on understanding the data and ensuring accuracy. This also calls attention to the implica- tions for addressing changes in public outreach; Kingsberry states, “The expansive amount potential to lead to more suc- cessful agency activities, and a more satisfied constituency. Below are fives ways, as indi- cated by Kingsberry, that an agency can create a successful big data program. 1. Identify a Clear Business Need or Problem Big data is an excellent tool to use in order to better in- form business decisions. To fully leverage a big data initia- tive and identify new insights through big data programs, agency leaders cannot just haphazardly place big data into a business strategy with- out first identifying how data can be properly used. “The first thing is for federal gov- ernment to get their head around business requirements and not get caught up in the buzzwords and the technol- ogy of what seems interesting right now,” warns Kingsberry. With the rapid dissemination of information on the Internet, buzzwords can lead to hype and premature dedication to a specific technology program. Not every new computing ad- vancement or mobile strategy will fit every agency. Federal agencies must understand their business objectives and how data can be part of the solution, prior to committing time and money into a big data project or program. an agency such as the Recov- ery Accountability and Trans- parency Board where data needs to be collected from ev- ery recovery aid-related agen- cy. Once the issue is properly identified federal data sharing will have, according to Kings- berry, “a lot of opportunity for maturity.” Another issue that agencies must be prepared to face is re- alizing that poor collaboration and communication within an agency may also be a challenge in addition to implementing new technology. “Technol- ogy is not the challenge. If you get the right technical people sitting at the table, you can solve any technology prob- lem. The challenge is people and culture,” states Kingsberry. Departments have their own culture and way of working through issues, but those cul- tures may clash. To avoid con- flicting ideas, Kingsberry sug- gests that agencies “Remove technology from the conversa- tion. Talk at the business level about the outcome. With the of growth is telling you that new customers and new users, are going to have expectations that when they ask questions they will get performance and integrity from the data.”There- fore, improved performance and service delivery can only happen if data is accurate and timely. Big data, when used in a quickly assembled govern- ment strategy, can become cumbersome and leave em- ployees and constituents more overwhelmed and confused. However, when big data initia- tives are thought out and de- veloped out of concise agency objectives, big data has the 2. Identify Risks and Issues Working with raw data and large sets of data can be chal- lenging in government. Agen- cies are often working with in- formation that should remain private within the agency and not shared externally. It is im- portant to recognize the na- ture of the data before imple- menting a strategy. However, sometimes the issue is of an opposite nature. Government agencies can often be isolated from each other and have diffi- culty sharing information with other agencies. “If one of your risks is ‘we need to do a better job providing more quality in- formation or a more useful sit- uation to our customers,’ and to get there requires you to connect with other data sourc- es that are outside of your agency, you have another is- sue,” says Kingsberry. To obtain the best information to make the most informed decisions, agencies need to connect and share data sets, especially in Federal Data Growth: By the Numbers 2021 1990 180,000 petabytes 20,000 petabytes month month
  • 13. 24.GOVERNMENTBIGDATA23. THEGOVLOOPGUIDE of data integrity.” These ques- tions can help agency leaders know not only the limitations of the data, but also the poten- tial of the data. They can then understand how to leverage data in the best way to accom- modate the growing expecta- tions of customers and to fit into a plan designed by lead- ers of the agency. Recognizing the scope will allow agencies to properly leverage data to accomplish the agency’s mis- sion objectives. 4. Identify Resource Needs While big data is extremely helpful when leveraged to make decisions, agencies need to understand the resources that they have and extract ac- tionable insights from data. Kingsberry advises when im- plementing a new technology, whether it is a mobile strategy or utilizing the cloud, agencies need to look and understand their portfolios. A portfolio is a list of technologies and their appropriations, laying out the limitations of techno- logical and fiscal resources of an agency. “In essence, it is all about project management and portfolio management,” says Kingsberry. He cautions, “Agencies don’t have to think differently,”meaning analyzing and understanding your re- source needs is not just about thinking innovatively outside of the box. Instead, agencies must identify objectives and recognize the work that must be done in order to accom- plish their goals. To do this, Kingsberry suggests asking certain questions about your portfolio: What are agency risks and issues associated with de- livering the goals and ob- jectives to meet the vision of my portfolio? How can technology better optimize the outcome, and better meet goals and ob- jectives of the agency? 5. Enable and Optimize Services Kingsberry pointed out that very recently, the RATB was able to “run two million re- cords against 100 million rows in roughly two minutes,” a pro- cess that used to take hours, if not days, to run. “We’re con- stantly looking to optimize,” states Kingsberry. The ability to quickly and efficiently find knowledge out of data means that data can become more actionable, and lead to stron- ger insights for improved de- cision-making. For instance, at the RATB, the ability to quickly process millions of records leads to improved decisions around Recovery Funds and transparency initiatives. The purpose of the Recovery Accountability and Transpar- ency Board is to provide in- formation to the public about Recovery funds so that other agencies, businesses and in- dividuals can see where gov- ernment money is going. Publishing a report or post- ing information on a website is helpful in reaching out to constituents but in order to optimize activities and trans- parency, agencies need to consider mobile technology. At RATB, “customers can access our infrastructure via tablets, because of the infrastructure when you look at our analytic cloud. So in essence, that is mobile and mobile is a way of interacting with the data,” says Kingsberry. As previously stated, big data is more than just acquiring im- menseamountsofinformation, big data is about actionable insights and is an important part of a digital government strategy. “You can’t talk big data without talking mobile, without talking cloud, and without talking information assurance. They all go hand in hand because at the end of the day it’s all about the data. Everything else is how you in- teract with that data.” If agen- cies leverage the data sets that they acquire and utilize tech- nologies such as mobile and cloud, then they will be able to better serve their constituents and meet agency objectives. The important action to take, as Kingsberry has expressed, is to first identify the scope of the data and to fit that into the mission of an agency. Once that is accomplished, big data can aid government agencies in improving transparency and public services. right people, the business side and the technology side of the organization will be sitting at the table together. What you’re going to see is that you are go- ing to begin to get people on the same page.” 3. Craft a Clear Vision Good leaders not only craft a clear vision, but also know the attributes, quality, and integri- ty of data to set realistic expec- tations. To better understand data, Kingsberry suggests that agencies ask questions such as “What is the data? What are its attributes? What is the level of quality of the data?This assures that I have an appropriate level From the GovLoop Survey: Does Your Organization Have Data Scientists on Staff? (Figure 6) As education was identified as one of the main challenges for big data initiatives, 61% of agencies indicated they do not have data scientists on staff. This information is further evidence that an es- sential part to adopting big data will mean providing new training opportunities for existing employees, and leveraging their skill sets in new ways. Although the title “data scientist” may not be a formal role within an agency, leaders must certainly continue to train em- ployees to serve in a data scientist capacity. This means leaders must have employees on staff that focus on data, and learn the best ways to identify intelligence from data collected across the agency or de- partment, and collaborate with partnering agencies. 39% 61% No Yes “You can’t talk big data without talking mobile, without talking cloud, and without talking information assurance. They all go hand in hand because at the end of the day it’s all about the data. Everything else is how you interact with that data.”
  • 14. 26.GOVERNMENTBIGDATA25. THEGOVLOOPGUIDE Recently, Audie Hittle, Chief Technology Officer (CTO), Fed- eral Market at EMC Isilon, shared his insights as to how big data initiatives are transforming gov- ernment and the role of govern- ment employees. As Hittle states, “We are only at the tip of the iceberg and I believe big data can be transformational.” Hittle’s statement could not be more poignant, as agencies are looking to streamline processes and identify new efficiencies. As this report has shown, big data analysis has many benefits for government agencies; “One of the areas big data certainly offers is the op- portunity to make better decisions and make more efficient use of all resources,”Hittle states. Across all levels of government, focusing on finding new efficiencies is essential, especially in a time where budgets are being reduced, coupled with high levels of fiscal uncertainty. Yet, efficiency for government does not just mean the benefits of quicker processing, more efficient services, and improved decision mak- ing. This also means the improved efficiencies within the job of a government worker. Hittle notes, efficiency “enables people to get more gratification out of their job, because they feel they are more efficient, they are accomplishing more, they are contributing more, and those are great things.” Hittle shared a case study from the Air Force, which identified the improved efficiencies for the workforce. The Air Force implemented a big data program and was able to reduce the num- ber of dedicated storage professionals. In doing so, the Air Force was able to reallocate staff and place employees on more mission critical and support roles. Hittle states, “in some cases you can see where placing employees on mission critical roles provides a career progression or a career re-training opportunity to move from one highly skilled area, where it deals with IT management, into other areas where it deals with knowledge extraction or analysis.” The Air Force is not alone in making improve- ments to the workforce. A second case study comes from an intelligence agency, which implemented an Isilon scale-out network-at- tached storage (NAS) solution. With this solu- tion, the agency was again able to reduce ser- vice professionals by roughly 90% and, similar to the Air Force, employees could be reallocat- ed to higher priority and direct mission-orient- ed services. In addition to transforming how the workforce operates, Hittle believes that big data will also facilitate new opportunities for government training. “What we are seeing here is that big data is going to create efficiencies that are going to lead to cross training and retraining opportunities that enable people to migrate quickly into these high priority roles,” states Hittle. Clearly, big data can help agencies transform their decision-making and service delivery. The impact on the government workforce cannot be overlooked, with tightening resources, IT managers must assure they are fully leverag- ing emerging technology as a way to redefine the role of a government employee, and fully leverage their skills and knowledge. With new efficiencies comes the ability to free workers from monotonous, time-intensive tasks, and allows workers to use their skills to contribute to higher value mission-centric objectives. BIG DATA IT’S ON ISILON • Store & AnAlyze your DAtA • Protect your DAtA • Secure your network www.emc.com/federal GAme-chAnGinG technoloGieS for iSr & fmV Case Study: Achieving Workforce Efficiencies with Big Data An interview with industry expert, Audie Hittle, Chief Technology Officer (CTO) Federal Market at EMC Isilon
  • 15. 28.GOVERNMENTBIGDATA27. THEGOVLOOPGUIDE Pat Herbert, Principal Solu- tions Architect, SAS, recently spoke with GovLoop on the importance of big data, com- mon challenges and how agen- cies can leverage big data to improve internal operations at a government agency. Herbert’s insights show how agencies can begin to find actionable intelligence from big data, and leverage their data in new, inno- vative ways. Like all our expert interviews in this report, Herbert cautions agencies not to get lost in de- fining big data in terms of size or scale. Herbert states, “We do not define big data as a func- tion of scale or size exclusively. Big data is the amount of data or the complexity of data that exceed a given users comfort, their ability to handle that data in ways they have tradition- ally handled it, so it is something that’s bigger than they have dealt with in the past but big- ger does not always mean size” For Herbert, the ultimate goal is taking big data and finding new value, actionable insights and using data as a strategic tool to transform an agency. During the interview, Herbert men- tioned some common challenges and best practices for big data analysis. One of the first challenges that Herbert mentions is the chal- lenges related to governance, “Ultimately a challenge is a data governance issue, the abil- ity to use the data the way agencies need to in order to access, but also in a way that is effec- tive for agencies.” Governance challenges are also multiplied as data is often fragmented across a variety of dif- ferent agencies. Along with governance chal- lenges, this also results in challenges related to collaboration and extracting value from data. “The challenge is not having data, it is having access to data and then being able to use it in- telligently,” Herbert states. Your data is constantly growing and changing. Now it’s time to see it for all it’s worth. A report from CIO Market Pulse confirms that data visualization helps organizations drive discovery and collaboration. Get the speed of analytics without the wait for IT-generated reports. Explore billions of rows of data in minutes or seconds, visually presented in a striking way that brings hidden patterns into plain sight. Then share real-time insights via the Web or mobile for faster data payoffs. 77%Confirm improved decision making as a top benefit. 68% See the potential to collaborate, report and share information. VISUAL ANALYTICS Plan to use Visual Analytics in their Big Data strategy. 98% Each SAS customer’s experience is unique. Actual results vary depending on the customer’s individual conditions. SAS does not guarantee results, and nothing herein should be construed as constituting an additional warranty. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. © 2013 SAS Institute Inc.All rights reserved. S109065US.0513 How to Identify Actionable Insights from Big Data An Interview with Industry Expert Pat Herbert, Principal Solutions Architect, SAS The goal with big data analysis is to find new associations between variables, that otherwise would remain unknown. An example would be to look at the data collected by a school dis- trict, transportation department and public safety data, which all may have data points that looked at in isolation may seem irrelevant, but when merged with other variables, new as- sociations and trends can be found. Yet, the ability to share data across depart- ments and agencies remains a challenge at all levels of government. Herbert states, “Data infrastructures aren’t typically put together in a way that permits them to easily share data, and as a result there is the potential to be able to have extremely valuable data, but their ex- ecution ends up locking them out of exercising their full potential from that data.” One of the lessons learned that Herbert shared with GovLoop is the necessity to focus on bal- ance while implementing a big data program. Agencies must approach big data with a clear scope, defined goals and defining what success looks like. Herbert says he has seen both sides of the spectrum in adoption, such as agencies looking to adopt an enterprise wide strategy right off the bat, and also agencies looking to adopt smaller, less mission-focused programs. The key for agencies looking to leverage big data is finding the right balance and knowing the appropriate level of investment in a big data program. Herbert states, “Identify a proj- ect that may not be the most critical, but is an important project. Work on that as a complete initiative, and then expand on that rather than trying to build out a big data initiative that covers every single bit of data.” In doing so, agencies can begin to unlock actionable intel- ligence from big data.
  • 16. 30.GOVERNMENTBIGDATA29. THEGOVLOOPGUIDE Using Big Data to Prevent Waste, Fraud and Abuse o witness improved cost savings in government, there has been an in- creased interest in using big data analysis to detect fraud, waste and abuse. Upon analyzing various data, the Gov- ernment Accountability Office (GAO) realized that fragmentation, overlap and duplication were an issue in government, causing an im- mense waste of funds. Nikki Clowers, Director of Financial Markets and Community Invest- ment Issues at GAO, explained in an interview with GovLoop’s DorobekInsider the nature of fragmentation. “Fragmentation refers to a situation when you have multiple agencies providing services in the same broad area. If there is a big issue facing the nation you can imagine there are a wide number of agencies that might be in- volved; but what we find is, fragmentation can be a harbinger for overlap and duplication which is a more serious issue.” Fragmentation can greatly affect the efficiency of agency pro- grams. Often, information can fall through the cracks of several programs because of miscom- munication on which agency is responsible for what aspects of an issue. Fragmentation often leads to duplication and overlap. Duplication, according to Clowers, is when “the same agencies in the same broad area provide the same services to the same beneficiaries.” This is different from overlap, which is when “you could have multiple agen- cies in the same area with similar activities but the beneficiaries might be a little different,”
  • 17. 32.GOVERNMENTBIGDATA31. THEGOVLOOPGUIDE states Clowers. In the end, both fragmentation and duplication lead to a significant waste of government resources. Over the years, GAO has re- searched where duplication and overlap have occurred in order to identify those instanc- es in order to prevent them. Clowers says, “We [GAO] start with the budget, and look- ing at different functions at the highest level, you can see where there could be a poten- tial for overlap. From there we drill down to the strategic plan and other agency documents. We go out and interview offi- cials. We go on-site to see the services and activities being performed.” More often than not, the cause of the redun- dancy is missing data, whether it is lack of budgetary informa- tion or performance data. That said, it is important to note that redundancy can be useful for agencies, such as Department of Homeland Security and law enforcement. However, the overlaps must be coordinated, “because if it is not properly coordinated, that is where we will get confusion and gaps,” said Clowers. The take-away from Clowers and the work at GAO, in the simplest terms, is that big data matters. Additionally, Jennifer Kerber, President of the TechAmerica Foundation, spoke on Gov- Loop’s DorobekInsider, provid- ing insights to a recent TechA- merica survey that confirmed the importance of big data. “Budgets are tight especially with the government trying to cut $85 billion in sequestration cuts. So I think there is a sig- nificant focus on how big data can help reduce waste, fraud and abuse,” states Kerber. As previously mentioned, ac- quiring and using data is one way to identify and prevent waste. However, disorganized data might be more detri- mental than no data at all. In an interview with Kerber, she detailed several three types of data that could help in saving money. 1. Controlled Data In today’s technologically based world, data is developed and collected at incredible rates. While many agencies are able to collect this data, often the volume can become cum- bersome and, therefore, the data remains unorganized.“We are just now at a point where the amount of data that’s com- ing in and the ability to con- trol that data is allowing us to have ‘Smart Data,’” says Kerber. ‘Smart Data,’ or data that is or- ganized into sets, can prove to be an excellent resource for running analytics software to detect waste or fraud. 2. Real-Time Data “The ability to do some of this analysis in real-time allows you to better deliver services to customers,” states Kerber, “Public safety officers can now use big data to reduce crime and target criminal hot-spots. One of the most exciting ar- eas is health care. You can do targeted searches in cancer research for example.” Data that is no longer relevant can be dangerous when agencies depend on it to plan actions or programs. Accurate data that is presented in real-time allows agencies to make quick decisions based on updated information. 3. Synthesized Data No matter how much data is collected, it is not very useful if data sets cannot communi- cate with each other. “Data si- los are also a big concern,” says Kerber. It’s important that data sets from different parts of an agency are interconnected so there is not duplication within an agency. That said, it is also vital that data from various agencies across government can be synthesized in order to detect overlap and waste on a larger scale. These efforts are still being developed, ac- cording to Kerber: “Right now a bunch of smart people are working to make all the data able to talk to each other.” With the government facing tight budgets while promis- ing to provide transparency, it cannot be denied that big data is important. “The potential is enormous,” Says Kerber, “It’s evolutionary. It’s almost like the Internet. These days no- body asks if you are on the In- ternet anymore, it’s just a way of life. Eventually we see that same evolution in big data. The data analytics and the de- cisions behind it will just be- come a part of life.” The key is to focus not just on collecting and using data, but harnessing the data to turn it into orga- nized and easily usable infor- mation that can inform agency decisions and save hundreds of millions of dollars. DOES CONGRESS MANDATE DUPLICATION? Sometimes Congressional legislation causes duplication. One such instance is with catfish reg- ulation. “In 2008,” says Clowers, “the Farm Bill gave the responsibility for inspecting catfish to the USDA, but there were already two other agencies performing that function. We (the GAO) have recommended that the Congress take those responsibilities away. It is costing the USDA $14 million annually to regulate the catfish.” Over the years, GAO has researched where duplication and overlap have occurred in order to identify those instances in order to prevent them.
  • 18. 34.GOVERNMENTBIGDATA33. THEGOVLOOPGUIDE Y O U R B I G D A T A C H E A T S H E E T *H A D O O PHadoop is free to use and is a Java-based framework that supports processing large data sets that are from dispa- rate servers and hosted in various locations. *N A T U R A L L A N G U A G E P R O C E S S I N G ( N L P ) Component of artificial intelligence, allows com- puters to understand human speech. *M A C H I N E L E A R N I N G This is a type of artificial intelligence that allows com- puters to learn without being programmed – computers can adapt and grow based on data. *N O S Q L D A T A B A S E S “Not Only SQL,” address challenges for big data that re- lational databases cannot. It’s an approach to database design for large sets of distributed data, useful for data stored in the cloud, virtual and unstructured. *M A P R E D U C E A two-part process to understand massive amounts of unstructured data; map: parcels out data, and re- duce: merges data together, allows programmers to run programs across multiple machines. For more definitions, check out some of the fol- lowing: Big Data, Bigger Opportunities: Investing in Information and Analytics (Gartner Report) Big Data Glossary (O’Reilly Media) Key big data terms and glossary There are lots of benefits, but here are the top 5 benefits to re- member with big data: 1. Improve efficiencies 2. Improve services 3. Reduce costs 4. Allocate resources more effec- tively (do more with less) 5. Reveal new insights that other- wise remain unknown Why should govern- ment leverage big data? What do I need to consider? There are lots of elements to con- sider and, of course, this cheat sheet can’t get to them all, but here is the need-to-know infor- mation to get a strategic conver- sation started: 1. Who knows (or can learn) big data analysis on staff? Do we have skills in house? 2. How do we collaborate and what are the core privacy and se- curity issues? 3. Who creates data and what kind of format is it in? 4. What are we already doing to extract value from our data and how can we improve? 5. What specific problem are we attempting to solve? What are some exam- ples and resources to reference? 1. Case Study: Boston - Street Bump 2. Case Study: New York City - The Mayor’s Greek Squad 3. Case Study: Big Data for Cancer Care 4. Article: Big Data Revolution, Changing the Way We Live, Work and Think 5. Article: Big data: A Big Problem that’s Getting Bigger This report provided you with many lessons learned, best practices and case studies from thought leaders in government and industry who are leveraging big data to transform government. The following sections provide you with your big data cheat sheet, a brief sum- mary of the report and resources for you to find more information on big data. Big data analysis has the potential to radically transform how government operates. As we continue to witness an explosion of data, increasingly agencies need to focus on practices and strate- gies to extract knowledge and actionable insights. A L R E A D Y K N O W T H E N U T S A N D B O L T S O F B I G D A T A ? L O O K I N G T O G E T S M A R T Q U I C K O N B I G D A T A ? In either case, here is a quick reference sheet for you to review the need to know information on big data. Bit (b) 1 or 0 (short for “binary digit”, 3 bits is equal to a single color pixel) Byte (B) 8 bits (any character on a keyboard is 1B) Kilobyte (KB) 1,000B or 2^10 bytes (kilo = “thousand in Greek, one page of typed text is roughly 2KB) Megabyte (MB) 1,000KB or 2^10 bytes (The complete work of Shakespeare is equivalent to 5MB) Gigabyte (GB) 1,000MB or 2^30 bytes (Two-hour film can be compressed into 1-2 GB) Terabyte (TB) 1,000GB or 2^40 bytes (Tera = From monster in Greek, the entire Library of Congress, printed would fill 10TB) Petabyte (PB) 1,000TB or 2^50 bytes (It would take 500 million floppy disks to equal 1PB) Exabyte (EB) 1,000PB or 2^60 bytes (It has been said, all words spoken by mankind ever (in text) is around 5EB) Zettabyte (ZB) 1,000EB or 2^70 bytes (1 ZB is equal to about 2 billion years worth of digital music) Yottabyte (YB) 1,000ZB or 2^80 bytes (Cool name. Unimagi- nable amount of data. The entire World Wide Web is approaching 1YB ) Visualizing the Size of Data When someone says we have petabytes of data? What does that mean? Here’s your cheat sheet to help you grasp the com- plexity and size of data. 4 Core Steps for Big Data Here are four high-level steps for you to always consider for implementing big data programs: Learn from others that are leveraging big data successfully Build a strategic framework for harnessing the potential of big data Understand the human resource impact Determine the types of data available to you 1 2 3 4 Q Hello.
  • 19. 36.GOVERNMENTBIGDATA35. THEGOVLOOPGUIDE his guide provided you with some best practices, case studies and ex- pert insights to help you fully lever- age big data. But, we know that you’re busy – so just like we gave you a cheat sheet for big data, here’s everything you need to know about this guide, based on different settings you may find yourself in. 1. THE TWITTER VERSION Reading @GovLoop’s latest report on big data – handful of case studies and best practices: bit.ly/117vrGE 2. THE FACEBOOK VERSION Check out GovLoop’s report on big data – cheat sheet on big data, dozens of case studies – easy way to get smart on big data. http://www.gov- loop.com/profiles/blogs/transforming-your- agency-with-big-data 3. THE LINKEDIN VERSION Check out GovLoop’s report on big data – in- cludes big data survey from GovLoop com- munity and case studies sharing best practic- es, lessons learned and overcoming common challenges for big data initiatives. http://www. govloop.com/profiles/blogs/transforming- your-agency-with-big-data 4. HAPPY HOUR SMALL TALK BULLET POINTS The data government collects has the pow- er to change the way government does business, but government is challenged to extract knowledge and actionable intelli- gence. Philadelphia has implemented dozens of open data programs including releasing an Open Data Guidebook. Mayor Nutter named Mark Headd as Phila- delphia’s first Chief Data Officer, Headd is responsible for overseeing open data and transparency initiatives across Philadelphia. The Recovery Accountability Transparen- cy Board (RATB) is leading many big data programs in the federal government. They 5 N E X T S T E P S & C O N V E R S A T I O N S T A R T E R S worked with dozens of agencies to provide insights on the how stimulus money has been used to develop Recovery.gov. IDC has stated that the big data market is expected to grow from $3.2 billion in 2010 to $16.9 billion in 2015 (Source) You need special technology to do this (Ma- pReduce/Hadoop) – but can’t forget about leadership, vision, culture and workforce needs Eric Schmidt stated in 2010 that every two days we create as much as information as we did throughout the entire history of civi- lization up until 2003 (Source). 5. THE BIG DATA 30-SECOND ELEVATOR PITCH TO YOUR BOSS AND PEERS Have you had a chance to take a look at Gov- Loop’s Big Data report? They have a handful of case studies and best practices, and I think I got some ideas on how we can start to lever- age our data. Can we spend a half hour to talk through? Would love to float some ideas and see if they can work for our agency. Big data is changing the way government does business. Big data is typically defined with the three V’s: volume, variety and velocity. As agencies are now collecting data from a vari- ety of sources (social media, sensors, CRM, and ERP data), agencies need new and innovative ways to find insights and leverage the value of the data they are collecting. There are count- less examples (see above to fill your pitch with some great case studies) of leveraging big data to improve safety, public health and customer service in government.
  • 20. 38.GOVERNMENTBIGDATA37. THEGOVLOOPGUIDE A C K N O W L E D G E M E N T S The GovLoop team is thankful to all of those who contributed to this report. We thank everyone for their participation in our survey, active community engagement, input and knowledge shared while developing this report. Thank you to Bob Gourley for writing the foreward of this report. This guide would not have been possibility without your assistance and from the support of our sponsors, EMC and SAS. Lead Author: Patrick Fiorenza, Senior Research Analyst Co-Author: Kate Long, GovLoop Spring 2013 Fellow Editor: Andrew Krzmarick, Director of Community Engagement Editor: Steve Ressler, GovLoop Founder and President Lead Designer: Jeff Ribeira, Senior Interactive Designer Designer: Russell Yerkes III, GovLoop Summer 2013 Design Fellow For more information about this report, please contact Patrick Fio- renza, at pat@govloop.com. GovLoop’s mission is to connect government to improve government. We aim to inspire public sector professionals by acting as the knowl- edge network for government. The GovLoop community has over 65,000 members work- ing to foster collaboration, solve problems and share resources across government. The GovLoop community has been widely recognized across multiple sectors. GovLoop members come from across the public sector. Our membership includes federal, state, and local public servants, industry experts and pro- fessionals grounded in academic research. To- day, GovLoop is the leading site for addressing public sector issues. A B O U T G O V L O O P Location GovLoop is headquartered in Washington D.C., with a team of dedicated professionals who share a commitment to connect and improve government. GovLoop 734 15th St NW, Suite 500 Washington, DC 20005 Phone: (202) 407-7421 Fax: (202) 407-7501 GovLoop works with top industry partners to provide resources and tools to the government community. GovLoop has developed a variety of guides, infographics, online training and educational events, all to help public sector professionals become more efficient Civil Ser- vants. GovLoop’s report, Transforming Your Agency with Big Data is sponsored by EMC and SAS. If you have questions on this report, please feel free to reach out to Patrick Fiorenza, Senior Re- search Analyst at pat@govloop.com.
  • 21. 39. THEGOVLOOPGUIDE 40.GOVERNMENTBIGDATA R E S O U R C E S Big Data Resources for Public Sector Professionals http://www.govloop.com/big-data Are Big Data and Cybersecurity a Perfect Match? Emily Jarvis, GovLoop http://www.govloop.com/profiles/blogs/are-big-data-and-cybersecurity-a-perfect-match Turning Data in Decisions – Why Metrics Matter. Emily Jarvis, GovLoop http://www.govloop.com/profiles/blogs/turning-data-into-decisions-why-performance-metrics-matter Big Data, Big Fear, Big Potential. Danielle Blumenthal http://www.govloop.com/profiles/blogs/big-data-big-fear-big-potential Big Data, Social Media and the Long Tail of Public Policy. Nicholas Charney, Posted on GovLoop http://www.govloop.com/profiles/blogs/big-data-social-media-and-the-long-tail-of-public-policy Learning from the World Bank’s“Big Data”Exploration Weekend. Dennis McDonald, posted on GovLoop http://www.govloop.com/profiles/blogs/learning-from-the-world-bank-s-big-data-exploration-weekend Transparency Report Card - Did Your State Make the Grade? Emily Jarvis, GovLoop http://www.govloop.com/profiles/blogs/report-cards-are-in-did-you-state-s-transparency-make-the-grade Data as Paint, and the Rise of the Data Artist. Bob Gourley, posted on GovLoop http://www.govloop.com/profiles/blogs/data-as-paint-and-the-rise-of-the-data-artist Arlington Cemetery Goes Mobile - Take a Look at the New ANC Explorer App. Emily Jarvis, Gov- Loop http://www.govloop.com/profiles/blogs/arlington-national-cemetery-goes-digital-take-a-look-at-the-new-a How Big Data and Location Analytics are Impacting GIS for Government. Pat Fiorenza, GovLoop http://www.govloop.com/profiles/blogs/how-big-data-and-location-analytics-are-impacting-gis-for-governm Government Big Data: What’s Next? Experts Give Insight. Bryce Bender, GovLoop http://www.govloop.com/profiles/blogs/government-big-data-what-s-next-experts-give-insight Obama Administration Unveils“Big Data”Initiative: Announces $200 Million in New R&D Invest- ments. Press Release, Office of Science and Technology Policy, Executive Office of the President http://www.whitehouse.gov/sites/default/files/microsites/ostp/big_data_press_release_final_2.pdf 734 15th St NW, Suite 500 Washington, DC 20005 Phone: (202) 407-7421 Fax: (202) 407-7501