Companies that want to create user-friendly, transparent, quickly evolving enterprise apps are often hindered in their ability to do so by their outsourcers. Here's how to figure out when outsourcing agile development is the right move.
About four years ago, Medidata Solutions decided to switch from its traditional "waterfall" method of software development to an agile methodology. Medidata provides clinical testing solutions in a software-as-a-service model. "We made the change for all the usual reasons," says Andrew Newbigging, senior vice president of research and development. "We wanted to be more responsive to customer needs." At the same time, Medidata's IT leaders explored the possibility of outsourcing some of the company's software development. Though that might have made sense in the traditional waterfall world, they concluded that it was the wrong way to do agile.
Outsourcing managed network services
"We do an iteration, get feedback, and iterate again," Newbigging says. "That works well for us, and we were concerned that in any sort of outsourcing approach we would lose that ability to be responsive -- and end up with a product our customers wouldn't want to buy."
It's an opinion that many industry experts share. "We have seen cases where folks were successful outsourcing agile development. But they were the exception, not the rule," says Sean Kenefick, an analyst at Gartner.
He and many other experts believe that the best way to create a pure agile methodology is to keep all development work in-house. Companies that do outsource agile development will inevitably face tough tradeoffs: They'll likely have to give up some agile principles, as well as some of the cost savings typically associated with outsourcing. And managing an outsourced agile project is likely to be more difficult than managing that same project in-house.
Nonetheless, a growing number of companies will have to face the challenge of outsourcing agile development. In a survey of more than 6,000 software developers conducted by VersionOne, which makes a tool for managing agile projects, more than 80% of the respondents reported that their companies had adopted agile development.
Meanwhile, the trend of outsourcing more and more IT functions continues. According to Gartner's IT Outsourcing Forecast, outsourcing expenditures worldwide grew 8% from 2008 to 2011, and will grow an additional 6.6% in the next two years. Judging from those statistics, it's clear that at least some agile development projects will be outsourced.
The Case Against Outsourcing Agile
Why is it so rare for an outsourcer to successfully deliver agile development? Consider that agile development is always challenging, even in-house, with everyone at the same location. "It requires a huge amount of discipline and cultural change, and a lot of buy-in from the group, from the lowest-level person to the highest executive," Kenefick says.
Even a company that is successfully using agile may find it hard to maintain, he adds. "It's a very delicate balance. I've seen a situation where everyone was working in a bullpen and the developers wanted their own offices. That change was enough to disrupt the agile process. Just by moving a function from one side of a room to another, you make something difficult even more difficult. If you outsource it and take it to another company, you've made it that much harder."
Agile Communication
Can We Talk?
When people on the East Coast arrive at their offices at 9 a.m., it's already 7:30 p.m. in Bangalore. That might not be a big problem in the old-fashioned world of waterfall software development, but if you're using agile, which requires constant communication among developers, testers and the business users of the software, having team members in different time zones poses a serious challenge. What can you do? Here are some tactics that have proved effective for successful outsourced agile projects:
1. Write detailed requirements. "When we need to exchange information about detailed requirements, the time difference is a challenge," notes Rene Rosendahl, senior manager in the project management office at Kelley Blue Book. "We're mitigating that by providing more detailed written information than would be needed if it weren't offshore. The goal is to minimize the questions that come back to us."
2. Use collaboration technology. Kelley Blue Book uses a tool called VersionOne to manage agile projects and keep the lines of communication open within its agile teams. And that's not all. "We are heavy users of instant messaging and email," Rosendahl says. "So if someone's gone home for the evening and offshore team members need information from that person, they might get it via email or IM."
3. Ask offshore workers to match your time zone. Many developers in other parts of the world approach agile development for U.S. companies by working hours that, to them, are odd. "Most of our team based near New Delhi are operating on Eastern time. That helps a lot," says Shane Aubel, CIO of the outsourcing company Tarika Technologies. The Indian workers are at their jobs from around 11 a.m. their time to 7 or 8 p.m., he adds.
It helps to not keep anyone on the late shift for too long, notes Kevin Quick, North America testing lead for Capgemini. "It's a rotational thing, so our people can manage their lives well," he says. "We learned the hard way that if we leave people on the late shift for too long, we tend to lose them."
4. Keep some team members onshore. "My biggest recommendation is to make sure that the designers, architects and engineers are located onshore," Aubel says. "We do a lot of the architecture, design and requirements, and then the specifications we send to the team are pretty well defined. It's just a matter of coding. The challenge arises when you try to start offshoring design and architecture."
But some industry experts are skeptical about this sort of approach for a truly agile methodology. "If you're doing waterfall development, it's OK to have a Java person who only knows J2EE," says Max Rayner, executive-in-residence at Hudson Crossing. "In agile, you want developers who think like business people. It's not enough that they can program. They have to be engaged and challenge the demands, thinking of the outcome rather than the process. So a lot of the outsourcing companies that are coder mills have a problem because they don't have talent that is able to engage with core business matters, just on how well their code is written."
5. Buy lots of plane tickets. Videoconferencing, instant messaging, document-sharing and remote scrum meetings all help, but in the end, nothing compares to meeting face to face. So IT leaders who've successfully managed offshore agile projects recommend frequent visits -- in both directions. "You may have parts of your onshore team going offshore to meet the offshore scrum team in person and introduce them to your technology," Rosendahl advises. "And you might also plan for offshore resources to come onshore to keep the exchange going and continue building these relationships. It's not cheap, and it takes effort and time, but it's well worth it."
AA Minda Zetlin
To make matters worse, using an agile methodology runs counter to most outsourcers' business models. "Every outsourcing company has its own methodology for developing software, which it wants to use for all its clients," says Alex Adamopoulos, CEO of Emergn, an IT consulting firm focused on agile and lean development. "That's not necessarily a bad thing -- they want to find ways to run their organization most efficiently. But it makes them less likely to adopt whatever methodology a client company is bringing."
Indeed, embracing an agile methodology is likely to make the outsourcing company's work considerably less efficient. "One of the benefits of agile is that you can take shortcuts while you develop in order to release more quickly. Then you go back and refactor the code later," Kenefick says. "But how do you do that when a third party is doing the coding? They want to get it done once, the right way. As an outside vendor, why would I want to rewrite the same code more than once if I didn't have to?"
Then there's geography. Many outsourcing arrangements involve working with programmers in parts of the world where labor is cheaper than it is in the U.S. But if moving a function across a room can disturb the agile process, moving it across an ocean is worse.
"A fundamental aspect of agile is really quick feedback," Kenefick says. "If you've got people in different time zones, you won't have those conversations as often as you need to. I'll write some code today, but then I won't get feedback on it for 24 hours."
That's one reason why the agile methodology works so well when teams are all in the same place, he adds. "It is very hard to colocate teams, but it's the first thing I'd put on my list of effective agile practices."
If outsourcing agile development makes a challenging job even more so, is it a better strategy to keep all agile development in-house? For a growing number of companies, the answer seems to be yes. "We're seeing a trend toward companies that have outsourced in the past choosing to invest in their own people's skills and capabilities instead," Adamopoulos says. "Smart companies are figuring out that the cost savings from outsourcing aren't that significant. For instance, one insurance company we work with is bringing more of its development for key projects back in-house so as to have better employee retention and less risk. Their view -- which has been that of a number of our clients here and in Europe -- is that traditional outsourcers aren't helping them get products to market fast enough or well enough. The change rate is slower on the outsourcer side, so to offset that, they're building up the capabilities of their own people."
Team Augmentation
Outsourcers as Team Members
When SciQuest, which provides software-as-a-service supply chain management tools, decided to switch to an agile software development model about five years ago, the company already had a well-established relationship with an outsourcer in India. "A big chunk of our work was being outsourced," says Daryl Broddle, vice president of technology. The outsourcing company was a small, entrepreneurial firm that was willing to change its practices to accommodate the new methodology.
So SciQuest began creating teams, as in a classic agile setup. "The entrepreneurial partner augments our teams," Broddle says. "The teams focus on a strategy, and the developers at the outsourcer participate in our daily standup every two or three days. We've integrated them into our process. We don't write a bunch of stuff down that we send to them."
SciQuest is based in North Carolina, and the two companies deal with the time difference by adjusting their work schedules, something that Broddle says is very manageable. "They come in at 9 or 10 a.m. and work till 6 or 7 p.m.," he says. "We wind up with three to five hours of overlap. And if we need to have a meeting where we have to have a long discussion, then we'll come in at 7 a.m."
To further aid collaboration, one of the outsourcer's developers is on-site full time at SciQuest. "He's one of the four people on one of our four-person teams," Broddle says. "I treat him as one of my staff, but he's also our account manager. For instance, if one of the developers in India is not working out well, he handles it."
This scenario has been working well for more than five years, Broddle notes. "They were pretty small and just starting out when we first started partnering with them," he says. "They've grown along with us, and they are now about four or five times as big as they were when we began."
Working with the outsourcer lets SciQuest meet its goal of getting new features to customers faster. "We have three major releases a year, but in between we use focus groups," Broddle says. "We show them new functionality and get their input long before we put a new feature into the production environment. With the outsourcer augmenting our teams, we can get something done and ready to implement in front of our focus groups within a two-week sprint. We're not showing them screenshots -- it's real code."
AA Minda Zetlin
That's the decision Medidata made last year when the company decided to expand one of its software offerings and once again took a serious look at outsourcing agile development. "We decided to hire and increase the size of our internal development team instead," Newbigging says. "We feel quite strongly that we're better off having our own developers building the software, and also being responsible for maintaining it, responding quickly to any issues. They are able to understand the software because they built it in the first place, and that's harder to achieve if the original development was done elsewhere. You don't have that same depth of knowledge."
Outsource for the Right Reasons
While keeping all agile development in-house may top the wish list of many IT leaders, it's not a realistic plan for every company or every situation. With looming technology skills shortages and pressure on IT budgets, some agile software projects will have to be outsourced.