The ESRI Developer Summit and the .NET SIG

Play this below to set the mood:

That Was Then

Way back in 2005, at the ESRI International User Conference, there was a .NET SIG that essentially started something great. In that room there were some great folks (Scott Morehouse, Art Haddad, Brian Golden, Rob Elkins, Jithen Singh, Brian Flood, Dave Bouwman, and others) who talked about where we should take the developer community at ESRI. In my opinion the biggest thing to come out of that meeting was what became the Developer Summit.

I’m sure most ESRI developers feel the same as I do in saying that the DevSummit is probably the biggest thing to come out of ESRI in the last 10 years. It has grown to be probably the must attend event for many ESRI users. At at the DevSummit, the .NET SIG (as well as the other ones) became sort of a place to reconnect. It didn’t matter if you were web or desktop development, used Desktop or Server or worked in C# or VB.net; you could talk about what the .NET community was doing at ESRI and how ESRI could continue improving it.

A Brave New World?

Well looking at the 2010 ESRI Developer Summit Agenda I can see the SIGs have been dropped. I asked a couple contacts at ESRI if this was just an oversight on the website and they confirmed that the SIGs are no longer part of the program. I guess the idea is that you’d rather “Meet the Teams” to talk about what you are doing directly with them. Of course most folks probably won’t bother because they’ll be meeting the teams at the ESRI Islands and talking with them all week.

What I think I’ll miss is the strategic talk about how ESRI can improve their developer community. I thought this feedback was valuable to ESRI, but I guess these days it is better captured through contact us forms than face to face discussion. Part of what makes the Developer Summit so great is that it isn’t like any other ESRI event and I’m afraid that this is just the start of it losing its “woodstock” feel. Of course maybe change is inevitable but I can’t help but note it sucks.

Posted in GIS | 5 Comments

Data.gov Is Already Broken — Just Like Everything Before It

Like most people (I assume), I was doing a little GIS project SuperBowl morning. Needing some data, the first place I thought of going what the new [Data.gov] site to download some data. After doing a quick and simple search, I got the dataset I wanted ready to download. But as with every government data repository before it, it is broken. Posted datasets download links are many times 404:

Broken download

It just isn’t the download, but the metadata as well. I know, some datasets still work and who knows, maybe this one will again one day. But for [Data.gov] to be valuable it needs to ping the data sources to let the users know that they are down (and for web services what percentage they are down). Also it wouldn’t hurt to let the owner of the data know that their datasets are no longer linked correctly in the Data.gov website. Otherwise we’ll just get link rot and that can kill a project.

If projects are going to be built on data discovered with Data.gov, much more has to be done to ensure that this data is available consistently, not when people get around to updating broken links. If things don’t change it is another waste of taxpayer money and we’d just have been better off sticking with the previous government data boondoggle.

Posted in GIS | 9 Comments

Increasing U.S. Census Participation

One of the biggest issues with the U.S. Census and probably the one that wastes the most money is trying to count those who are hard to count. My personal fix would be to use sampling to solve the problem, but for now the task of the Census takers is to try and count everyone. My attention was brought to a project called “Census Hard to Count 2010” which maps the “hard to count” population nationwide (based on the Census Bureau’s analysis) to help local and national organizations target their outreach efforts for the 2010 Census and customize messages to communities at risk of being undercounted.

It features interactive maps at the state, metro, county, and tract level, along with detailed statistics for each area. You can search in various ways, and also add overlays showing Congressional districts, ZIP Codes, tract-level maps of 2000 Census mail return rates, and recent foreclosure risk. There’s a FAQ that goes into details about the data and their methodology.

Clearly larger states have a bigger problem with hard to count populations but Alaska, Hawaii and New Mexico probably point out that there are socioeconomic factors as well.  Using the demographic layers available in the web app shows that this problem is very difficult to pinpoint and my hat is off to those trying to crack it.

The UI from the Census Hard to Count 2010 Application

Posted in GIS | Tagged , , , , , , , , , | 18 Comments

GDAL/OGR 1.7.0 Released

Good news from the gdal-announce email list:

The GDAL/OGR Project is pleased to announce the release of GDAL/OGR 1.7.0.

Yep, you can stop there and get your GDAL/OGR on.  Or maybe you want to know what is new, copied directly from Frank’s email:

  • New Raster Drivers: BAG, EPSILON, Northwood/VerticalMapper, R, Rasterlite,  SAGA GIS Binary, SRP (USRP/ASRP), EarthWatch .TIL, WKT Raster
  • GDAL PCIDSK driver using the new PCIDSK SDK by default
  • New Vector drivers : DXF, GeoRSS, GTM, PCIDSK and VFK
  • New utilities: gdaldem, gdalbuildvrt now compiled by default
  • Add support for Python 3.X. Compatibility with Python 2.X preserved
  • Remove old-generation Python bindings.
  • Significantly improved raster drivers: GeoRaster, GeoTIFF, HFA, JPEG2000 JasPer, JPEG2000 Kakadu, NITF
  • Significantly improved vector drivers: CSV, KML, SQLite/SpataiLite, VRT

I did a little highlighting up there to list what I think is noteworthy at least for me.  You can either build it yourself or keep an eye out for an update of FWTools.

The Leningrad Cowboys will play us off, have a great weekend folks!

Posted in GIS | Tagged , , , | 4 Comments

Rolling Your Mapping Apps on the iPad (or the iPhone)

One thing that has become crystal clear is the preferred method of having a mapping application on the iPhone and by extension the new iPad is to create a native iPhone/iPad app.  That said, the noise sometimes causes people to miss some great web mapping app (as native web apps).  I’ve looked into using SVG and even OpenLayers in the past for mapping in the iPhone, but who is rolling their own web apps out there to accomplish what until 2 years ago required a browser on a laptop or desktop?  I know there will most likely be a session at the ESRI DevSummit using OpenLayers, but is there a framework people are working with?

Can anyone find me some mobile web mapping applications to love?

Posted in GIS | Tagged , , , , , | 17 Comments

Government Open Data Updates

Despite some speed humps, many cities and governments are going full speed ahead with opening their data.  One of the biggest is the City of Vancouver’s Open Data Catalogue (note the copy and paste spelling of catalog, those wacky Canadians).  Well they’ve launched a new update that simplifies the process of navigating the data.  Every time I stop by I see more and more data available in more formats.  I think the city should be commended for their embracing open data sharing with citizens.

The other open data update is the data.gov.uk website.  The search is less than useful as you can’t perform advanced searches.  Sean Gorman did a quick look and didn’t find any specific geo datasets, but I’m sure we’ll start seeing them.  One thing that didn’t surprise me was the presence of SPARQL.  Why data.gov.uk would put such an annoying query language front and center is beyond me.  But with Sir  Tim Berners-Lee as and advisor I can only imagine that he pushed hard for its placement.  (note I’m not a big fan of RDF so take that as you will).  Still it is good to see the UK start working hard at sharing public data with everyone.

I wasn’t in Britain for the announcement of data.gov.uk, but I can only imagine it went something like this….

Posted in GIS | Tagged , , , , , | 9 Comments

Voting Is Open for the 2010 DevSummit User Presentations

One big change from the 2009 ESRI DevSummit is that users will now vote on which presentations they wish to see at the 2010 DevSummit.  Go here to pick which ones you think would be valuable to the community.  Normally I wouldn’t promote a talk myself (and I’m not giving one this year), but I think “Ruby-fu: Using ArcGIS Server with Rails” by Dave Bouwman is something people should be voting for.  Ruby is here to stay and there are many of us working on projects that use Rails at the backend.  ESRI of course already has a wonderful API to use with Rails so there is no excuse not to look at a quicker, more robust framework.

Oh, Ruby!

Posted in GIS | Tagged , , , , , , | 11 Comments

Safe FME 2010

So yea I’m a little late with this as I’ve been really busy this week. Still I wanted to get out the word (assuming that you pay zero attention elsewhere) that Safe has released FME 2010. Now I’ve got no scientific data to back this up, but I’ve imagined that they were done with FME 2010 for a couple weeks now, but had to wait until the new year arrived before they could release it officially. I of course can understand given they probably had everything printed up beforehand and who wants to be they guy telling the accountants that they have to reprint all their material because they wanted to release in 2009.

Or maybe not…

OK so some really great things in 2010 that I’m looking forward to using in production is the improved metadata support and of course the engine that drives WeoGeo, FME Server.  Oh Canada!

We hope you enjoy the beer, oh, like I mean the ETL, eh.

Posted in GIS | Tagged , , , , , , , , | 10 Comments

Community Geospatial Links to Haiti – Updated

USGS Shake Map for Haiti

Update Monday Jan 18th: Another update in an attempt to keep the links valid.

Update Friday Jan 15th: The team has gone back and updated some of the mapping links so check them out at the bottom of this post.  Dead links have been removed and new ones added.  Keep in mind much of this is fluid so sorry if the links don’t work when you try them out.


On Tuesday, January 12 a 7.0 magnitude earthquake struck about 10 miles southwest of the capital of Port-au-Prince, Haiti. The earthquake was the worst in the region in more than 200 years. With many poor residents living in tin-roof shacks that sit precariously on steep ravines and with much of the construction in Port-au-Prince and elsewhere in the country of  questionable quality, the expectation was that the quake caused major damage to buildings and significant loss of life, according to The New York Times.

Many companies are using this disaster to showcase their products and I think we need to try and share this open data outside of these silos.  Content below is organized by section:

  • Quick facts about Haiti
  • Haiti – Related Links
    • US Government
    • Non-Profit, Non-Governmental Organizations
    • New Media – Social Networking Sites
  • GIS – Data – Maps – Geospatial Information – GeoRSS
  • GIS Volunteers & Humanitarian Volunteer Sites

Read More »

Posted in GIS | Tagged , , , , , | 14 Comments

ArcGIS 9.4 Is Now ArcGIS 10

ArcGIS 9.4 is now going to be ArcGIS 10. Jack announced this in a podcast today.  I didn’t hear much new than we’ve hard before about 9.4 so it appears it is a name change right now.  I’m wondering if there isn’t more out there we don’t know about yet that will make it into the ArcGIS 10 release, but Jack says the name change is the smallest thing about this ArcGIS 10 release.  I guess we’ll learn at the FedUC and the Business Partner/DevSummit and it is still scheduled to release before the User Conference.

ArcGIS 10 in '10

Posted in GIS | Tagged , , , | 34 Comments

Thoughts on the GeoDesign Summit

I’m sure many of you have been following #geodesign on Twitter, but I thought I’d add some of my deeper thoughts.  First off, yes everyone in attendance realizes that we’ve all been doing this since the beginning of time.  GeoDesign wasn’t invented by anyone in particular, that was clear to everyone.

So I guess the next question what is GeoDesign and why do we need to even define it, especially if we’ve been doing this for years anyway?  Since we’ve all be already been doing this for years shouldn’t this be easy to define since we already have an understanding of it?  A Wikipedia entry has been started and I’d encourage everyone to take a look at it and refine it based upon your experiences.

I think a couple things helped bring so many people together from so many different disciplines.  With Architects, Planners, Engineers, Technologists, Researchers, Professors, Graduate Students and “other”; there was academia, government and private industry.  The one person in our industry that has the pull to get this done is of course Jack Dangermond.  He was also gracious enough to allow the organizers to use the new ESRI Q Building which was perfectly set up for a conference of this size.

Adena Schutzberg and Matt Ball both did a great job diving deep into the conference and it would be a good idea to read up on what was discussed and what needs to be done to move forward.  What I’m going to talk about is what I think came out of the Summit and what should be the next steps.

First off, there was a little push-back that was acknowledged at the Summit which seemed to revolve around the fact that some small group of people seemed to think they could take ownership of something everyone has been doing for years, GeoDesign.  I was also a little on edge about what might have come out from this Summit, but in the end it was unfounded. The group of folks from Michael Goodchild to Carl Steinitz all where very pragmatic about GeoDesign, how we involve more in the process of design (how crowdsourcing can be involved), to even deeper issues such as how we must fundamentally change how we as humans impact our environment.

Many showed examples of GeoDesign projects that they are currently work on to ones that were completed decades ago.  Also despite the Summit occurring on ESRI’s campus, there were many examples showed that included non-ESRI technology such as GRASS, Google Earth and SketchUp.  Jack also stood up on stage and hoped next year the organizers could include other software platforms and technologies that weren’t on stage this year.

So this brings up what to do next.  Where do we go from here.  Jack asked everyone in attendance if they thought we should move forward with the GeoDesign concept and everyone agreed we should.  The details on how were to do so was what we discussed Friday morning.  There will be a GeoDesign Summit next year.  Tom Fisher the Dean for the College of Design at University of Minnesota offered to host it there.  Given the warm weather though many though Redlands would be a great location to hold it again (Mid 70s in January is hard to beat).  Jack said that if the committee wanted to hold it at ESRI again he would offer up the facilities again.  Jack also said he wanted to unbrand the summit from ESRI and have it stand alone.  To do this the Summit will be moving off of the ESRI servers on to its own and engage other potential stakeholders.

Since there was so much content created and organized there was a discussion on how to best disseminate the data out to everyone.  This was probably the most contensious discussion.  On one had you have those who wanted to write books (grey hairs) and on the other there were those who wanted to set up a wiki and get more community involvement.  In the end it appears we will have both, a GeoDesign book you can get signed by your favorite GeoDesigner and a wiki the community can showcase their ideas and collaborate.

One problem is how to get this information out to the community at large.  Organizations such as the APA have the tools in place (and not ESRI branded) to facilitate getting the word out to their members.  Since there were many researchers present, there was also questions about how we can get funding in place from NSF or possibly even the World Bank since better planning and design is critical to helping reverse the destruction of the planet.

So bottom line?  I admit I’m not one with too much patience for “University think” and there was plenty at the first GeoDesign Summit.  But at the same time there was so much practicality shown that it isn’t hard to want to get Design and GIS more interconnected.  One group that I think was underrepresented at the Summit was Technologists (I can’t say Architects or Designers because in this crowd that means something else).  The gap between “GeoDesigners” and the public needs to be bridged with our work and our expertise.  Making sure that this is represented in this GeoDesign initiative is important and we are those who need to make sure this is grounded in reality and not locked up in University research.

So lets see what happens.  Will there be continued push back to “GeoDesign” from the geospatial community or will people want to be involved on the ground floor defining and encouraging GeoDesign?  I think we all realize powerful things happen when there is a marriage of design and GIS.

Posted in GIS | Tagged , , , , , , , | 25 Comments

5 Predictions Geo for 2010 and 5 Things That Won’t Happen

Here are 5 predictions for Twenty Ten.

  1. The shapefile dies: SpatiaLite + ESRI’s File Geodatabase API finally put a dagger in the shapefile.
  2. GIS on iPhone/iSlate (Apple Tablet) and Android/Chrome OS: With Apple and Google owning the mobile space, we’ll see more proprietary and open source projects being ported to these platforms.  Microsoft Tablet PCs and Windows Mobile/CE begin to die off.
  3. 64-bit: There will be some holdouts (*cough* ESRI), but most of us will be running native 64-bit code on our desktops and servers.  Now to just get more RAM in this laptop.
  4. Mobile: If you aren’t running on the iPhone/Android/Blackberry you aren’t relevant.  Web mapping apps become mobile browser aware.   Those that aren’t were probably irrelevant anyway.
  5. Google: Google’s APIs continue to push the envelope and they continue to be the standard for everyone mapping on the interweb.  Google is able to throw so much money and manpower at “problems” and their solutions are coming faster than anyone else can match.

Here are 5 things that won’t happen:

  1. Augmented Reality: Much like the Nintendo Virtual Boy, it sounds great until you try and use it.
  2. OpenStreetMap Dominates: Between Google’s quick improving of their database and continued licensing issues OSM plateaus.  Companies will continue to try and figure out how to monetize OSM, but fail.
  3. ESRI + Microsoft: This was on the top 10 lists for many people in 2009, but I don’t think we’ll be seeing deeper integration.  ESRI will continue to support multiple platforms (Google, OSM, Microsoft, “other”) and not become a Microsoft shop.  As Google continues to erode away at SharePoint and Bing Maps, ESRI will make sure that they don’t get caught in Microsoft’s blind spot.
  4. Geolocation other than Twitter, Apple and Google (TAG): Foursquare, Brightkite, and others will fade as TAG rolls out new APIs and ensure their mobile devices are tagging everything you do.
  5. MySQL falls apart:  Despite the dire predictions of Oracle or Monty destroying the project, too many people have too much invested in the project to let it fail.  MySQL will be fine and LAMP will continue to power Badgers.

Hey, don’t worry…  It’s gonna be a bright, sun-shiny day!

Posted in GIS | Tagged , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 59 Comments

Have a Very Merry Christmas!

So we are sitting around watching Santa work his way toward Tempe, AZ and it is time to send the boy to bed. I hope everyone who has read my blog this year has a very Merry Christmas.

Posted in GIS | 2 Comments

Twitter Acquires GeoAPI; The New GeoLocation Platform of Choice?

Given what we’ve witnessed since October, 2009 is sure going out with a bang. Google dumps Tele Atlas for their own mapping dataset and then gives away navigation, Microsoft adds street level imagery, Google adds oblique imagery and then gives away a spatial query server and Mapquest adds street level imagery as well.  But today Twitter did something that just seems to fit perfectly with just about any mobile application.  They went ahead and picked up GeoAPI.

Twitter clearly sees location as important as anything they do (I guess microblogging is something they do as well).  Tagging tweets with location is something fairly new to the Twitter API, but with smartphones probably being the primary method of tweeting, location becomes natural with tweeting.  We’ve been speculating that we could analyze tweets during “events” and see locations of tweets with information about what is being observed (flooding/fire/babes).  Having a richer geo-api will only facilitate this further and could be the real killer crowdsourcing app.

The only pushback I’ve seen on twitter is the location API can be very accurate.  I’d love to see them enable something like Fire Eagle where you can have it return a city level geocode rather than a hyperaccurate one.  I mean I’m glad everyone knows how often I visit the Apple store, but I’d like @pbissett to wonder just a little.

So I’m sitting here just fantasizing what can be done with the data provided by Twitter and GeoAPI.  I feel sort of like Clark Griswold…

Posted in GIS | Tagged , , , , , | 2 Comments

The Downfall of ArcGIS

So who says GIS or ESRI can’t be part of a meme?

Update: Looks like the creator of the video has posted it on their website.

Posted in GIS | Tagged , , | 26 Comments

Follow-Up to the Tempe GIS Data Request

You might recall the issue where I wanted some GIS data from the City of Tempe?  Well they finally told me to make a public information request and they’d evaluate my request.  Well I got back a response this week:

Dear Mr. Fee: I have reviewed your public records request for the “complete city of Tempe landbase and utilities in digital DGN format,” and discussed it with our City Attorney, Andrew Ching. He has advised me that, under the state public records law and cases construing the law, cities are permitted to weigh the competing interests of the public’s right to receive records versus the countervailing concerns of privacy, confidentiality, and the best interests of the city. Under federal law, city utilities such as water and sewer lines are considered critical infrastructure, which means that cities may restrict access to such data for homeland security reasons. As such, we generally limit access to utility mapping except for very limited parcels or sections, and not for the entire city. Therefore, your request is denied in part; we will release the complete landbase, but not the utilities. As an alternative, we would be willing to discuss with you further your proposed educational use of the information. It is my understanding you intend to use this for a class presentation to school children on the power of GIS. If that is still the case, we would be willing to discuss options for how you can present to the class while at the same time we can ensure that sensitive data is not disseminated. Please let me know if you would like to meet and discuss these options. Wendy Springborn, MBA Engineering Services Administrator City of Tempe

So as you can imagine I took them up on their offer of the Landbase data and I now have the city landbase in Microstation DGN v7.  I’d of course love to have unrestricted use of this data, but at this moment I’m in the process of preparing it to be loaded into PostGIS via FME 2010 so that I can start using it.  There was no metadata with the CD they gave me, but it was easy enough to figure out the layering system.  The quicker I get it unlocked from DGN and into open PostGIS, the easier it will be to work with.    Now I just have to make sure I remembered to get my wife a Christmas present.

Posted in GIS | Tagged , , , , , | 6 Comments

Enjoy the Holiday Road

It seems everyone I know is either heading out for the holiday week or getting ready to welcome people into their house.  Me?  I’ll be here all week blogging, but if you’ll be off the grid I’d like to make sure you have a wonderful holiday and see you in the new year.  And those back east?  I hope shoveling that snow keeps the pounds off. Take it away Lyndsay…

Posted in GIS | Tagged | 2 Comments

The Google Maps Data API and Google Fusion API News

It seems like not a week goes by (heck sometimes an hour) without Google just dropping a bombshell. Well this time it is a combination of things.

First we’ve got new functionality in the Google Maps Data API.  First off you can now perform geospatial and attribution queries on data stored on Google’s MyMap.  Now of course this isn’t paleo-type spatial queries, just simple stuff that solve 80% of all queries you’d need to complete.  Simple web apps need not fancy complicated APIs and clearly Google is the master of this.  So upload your data into Google’s My Maps and then query it to display on a Google Maps application.  Simple and sweet.

Second is an update to the Google Fusion Tables API.  As the GeoChalkboard blog rightly points out:

Now, obviously Google Docs has been around awhile so uploading your spreadsheet data to this type of application is nothing new, but the compelling thing about Fusion Tables is its integration with the Google Maps API and Google Visualization API.  Visualizations are also real time as Fusion Tables automatically updates data as it is updated or corrected.  With the Fusion Tables API you can also update or query the database programmatically.  Data can also be imported from various data sources including text files and relational database management systems.

The pieces are really coming together here.  Not only can you load and work with data, but you can freely visualize it.  And not only do it freely, but do it freely in a scalable environment.  Let that all sink in for a moment.  Google is enabling tools that we pay big money for with APIs that are so simple anyone can use them.  Check and mate for some geospatial companies I think.  Database + Visualization = GIS eh?

Too much information running through my brain…

Posted in GIS | Tagged , , , , , | 26 Comments

Git Yer ArcGIS 9.3.1 Service Pack 1

Yep, the service pack to the .1 release is here:

ArcGIS (Desktop, Engine, Server) 9.3.1 Service Pack 1 ArcSDE 9.3.1 Service Pack 1 ArcIMS 9.3.1 Service Pack 1 ArcGIS Image Server 9.3.1 Service Pack 1

UPDATE: Yikes, I left off ArcGIS Military Analyst 9.3.1 Service Pack 1

You can learn more on the “Issues addressed with Service Pack 1” page. I can’t think of any other way to celebrate than dear old Rocky Top…

ArcGIS, you’ll always be home to me…

Posted in GIS | Tagged , , , , , , , , , | 3 Comments

MapQuest Does Street Level Imagery

So yea, not a surprise.

As the name implies, 360° view provides fantastic panoramic views (360° horizontally and 160° vertically) of any given image within the 360 View coverage area (initially 30 cities and 15 suburbs across the United States with more to come). We have studied our industry, gleaning tidbits here and there, and polled our customer base in creating a simple, easy-to-use interface that fits seamlessly into the MapQuest mapping experience you have come to know and understand. Best of all, MapQuest 360 View “just works” without requiring any 3rd party player downloads.

Take that Bing Maps and your 3rd party player download.  MapQuest works without any Silverlight player to get in your way… except of course it uses a 3rd party player called Flash.  I suppose this plays into Adobe’s assertion that their 3rd party player download is included by default in many browsers by default.  Still it looks good and appears to have been taken sometime last year (the light rail line isn’t running yet in Phoenix and most stations haven’t been built yet.

A view of University of Phoenix Stadium where youll be seeing the true national championship; TCU vs BSU.

A view of University of Phoenix Stadium where you'll be seeing the true national championship; TCU vs BSU.

Now before you start going off an claiming this doesn’t matter, remember the real traffic numbers for the four main mapping sites:

Yep, Bing and Yahoo don’t add up to MapQuest’s reach.  I think it is critical to get this functionality into their API before more companies abandon it for Google While traffic numbers trend down over the last 6 months, I’m not sure it is losing to Bing or Yahoo.

Carry on MapQuest!

Kansas, a band so great a state was named after them.

Posted in GIS | Tagged , , , , | 16 Comments
  • License

  • Disclaimer

    The information in this weblog is provided "AS IS" with no warranties, and confers no rights.

    This weblog does not represent the thoughts, intentions, plans or strategies of my employer. It is solely my opinion and probably incorrect.

  • Meta