HMRC eFiling, “a bit of a disaster” says BASDA Chairman
November 2, 2007 by mike · Leave a Comment
“A bit of a disaster” is how the new HM Revenue & Customs (HMRC) Payroll eFiling programme was described, according to Dennis Keeling the outgoing BASDA Chairman, in a recent YouTube video.
In the video, Dennis Keeling is interviewed by PayPerShop presenting a highly critical analysis of HMRC’s new amendments to Payroll eFiling.
Dennis Keeling, BASDA Chairman (speaking on Payroll eFiling at SoftWorld)
He comments on the new HMRC Payroll eFiling programme calling it, “a bit of a disaster” citing that now the “Government has run out of money” for implementing the Carter 1 recommendations (specifically for end of year filing) falls to the software vendors to ensure that their products are compliant with the Carter “Review of HMRC Online Services” report.
Dennis goes on to say that come next April, all supporting software will need to be rewritten in order to support the Carter 2 (mid year filing) recommendations as well as the older Carter 1 recommendations, since our Government wants to run at least parts of both at the same time.
This means that if you use software to produce your P45/P46 (and you have to file online by law by April 2008 if you have more than than 50 employees) substantial parts of it will need to be rewritten by April 1st 2008 in order to support the new recommendations, but still keep the existing system for filing the payroll year end returns.
But I bet your current payroll software package won’t be ready on April 1st…
“Learning from lessons of the past”
Earlier this year, HM Revenue & Customs introduced a whole new taxation scheme for the Construction Industry, called the Construction Industry Scheme. If you’re a regular reader of my blog, you’ll probably know all about the failings of this scheme by now. If you don’t - please select the “Construction (new CIS)” category and catch up
This scheme was introduced on April 6th with absolutely no live black box testing. In other words, a whole new taxation scheme went live - with supporting software infrastructure and software products from third party software houses - all without adequate testing. The first time monthly returns were tested with real data was the day when a real monthly return was submitted. Nobody knew what might happen if the Gateway servers were innundated with requests (they crashed, of course), or were sent real life data which caused them to congest. Of course nobody knew, because there was absolutely zero live testing. No beta testing. No testing, period.
This lead to a long period of confusion by customers, HMRC with their head in the sand and software developers working all hours to ensure that customers were well supported. Meanwhile, presumably as a way to appease the electorate, HMRC promise not to fine anyone whilst the new software system problems are worked out. It turns out that contractors could still lose their gross payment status if not compliant during this time (such as if a monthly return couldn’t be submitted online in time) - even if it wasn’t their fault.
In short, it was a costly disaster for the industry and the software developers. Presumably this cost was not incurred by HM Revenue & Customs, who refuse to provide adequate testing facilities for the software requirements that they impose. Dear reader, do you think that HMRC’s own basic software offerings are untested like this?
A quick word to HMRC: A simple solution to resolving this mess would be to offer a proper test service for payroll testing, in a copy of the live environment. This would allow all software developers to be confident when releasing software to customers that it has at least been tested before the 1st April.
“When you consider that some very large companies are now going to be forced to file P45/P46 electronically, you’d have expected that [they] would have tested their software before going live.”
“To leave it until the last minute just isn’t the way you should do it”
- Dennis Keeling, BASDA Chairman.
If nothing is done (and I suspect this is the case), come 1st April there may be vast problems which by their nature are unforeseen. Going by last April with new CIS, I would expect to see a good mix of technical failure in vendor software, misunderstandings by customers, HMRC software failings, Government Gateway collapse, and a confusing PR backpedalling by HMRC and who knows what else? Perhaps the air conditioning for the HMRC servers will break like they did this year and all the machines will switch off?
My advice to anyone using Payroll software would be to check their software support license or maintenance agreement. Your software vendor is most probably already acutely aware of the Carter review implications and from past experience will likely schedule a “patch”/”fix” or “update” to their software shortly after 1st April as support tickets start to flood in. Remember, this new eFiling mechanism won’t be tested and there are no plans by HMRC to allow software vendors to test in live either!
If you are not covered by a support or maintenance agreement, you might find that the software you use will not appear to function correctly for online filing from April 1st 2008. In which case, I advise getting the arrangements for software support in place, in time for April 1st. Also make sure you know how to apply any updates from your software vendor. It goes without saying that software from us - is automatically updated with little or no effort from the customer.
Make sure that your software license entitles you to updates and fixes next April.
I’ll give the last word to Dennis, “This could be one of the worst disasters we’ve had in a long time”. And I agree.
A winning letter
August 31, 2007 by mike · 2 Comments
It’s been a while since I last updated my blog. There’s many reasons, mostly work related; I’m always busy. I’m not sure if that’s a good thing, it’s been 18 months since my last holiday - a two day break in bath. According to the beeb, I’m not alone. Must be ok then, I keep telling myself!
This month I won the prestigious “Winning letter“ in Payroll World. It was my words, but I didn’t actually send a letter in. Payroll World read my blog for the content, and managed to put together a decent edit of my point. Plus, I win a bottle of Laurent Perrier champagne. When that baby arrives it’ll make for a pleasant start to the weekend (and a change from the usual Tesco special offer wine deals).
I’ve also been quoted in a followup article running in the same edition too. You should head over to the Payroll World Website to read it, but since they only keep content up for a few weeks I have reposted the article in which I am quoted here on my blog:
The winning letter
The followup article
There’s not much else left to add, except for an update relating to HM Revenue & Customs….
They’ve asked me to drop my case.
I have, in the interests of running my own businesses and doing right by my customers, agreed to “ignore” or “overlook” the previous issues. I’ve provided all the information to HM Revenue & Customs, who inform me that they have passed this information onwards and upwards up the chain of beauracy. I’m not an industry campaigner, and I have no grudge against HM Revenue & Customs. However, the government need to learn how to take better care of its customers, just like us private businesses have to take over ours.
The point still stands however
HM Revenue & Customs still use two different methods for online and offline verifications. Admittedly, an entire 10 consecutive days have passed with not a single customer bringing this issue up. Is it fixed or have customers just learnt to work around or ignore the problem?
Either way, I shall be putting my attentions onto working on great software - and according to the wishes of HM Revenue & Customs - ignoring the problems that have gone on to date. We plan to log all future enquiries relating to this problem, and we will judiciously report these to HM Revenue & Customs. The problem is, that investigating these issues takes time. Our customers need to spend resources - people and time - and so do we - a costly exercise - to provide HM Revenue & Customs with this diagnostic information. These costs should be borne by HM Revenue & Customs, not us, and certainly not our customers.
I don’t plan to write much more on this issue and everything has already been said. I had some exciting and interesting articles planned, but haven’t got around to writing them yet.
Let’s hope things get better before October 19th.
A rebuttal to “spokesman” from HM Revenue & Customs
In a recent article in Payroll World (August 2007), I was featured as bringing attention to the “frequent” errors in HMRC’s online verification system.
I claim that there is a discrepancy between the online batch ‘automated’ verification service and the offline telephone verificaton service. In order to justify my claims, I have one scenario in which I lay down evidence which proves the discrepancy beyond all reasonable doubt. As the development manager, I am also responsible for ensuring that all of our customers are supported, and we have had many customers open support incidents with us to query why an automatic online verificaton has returned “unmatched” (that’s a 30% deduction - ouch to any business cashflow, regardless of whether you ‘offset’ it later) whereas a phonecall to the new CIS verification hotline quickly resolves the subcontractor under scrutiny as being matched.
Perhaps these errors only account for a small percentage of actual verifications performed. It is possible that in arguing “frequent” errors my definition is different to that of HM Revenue & Customs. I would suggest that any more than 0.2% of verifications being returned incorrectly unmatched would be “frequent” enough to cause severe cashflow problems for subcontractors, who, by working for a supplier using a batch verification mechanism without manual checks and overrides of tax treatment status, could suffer as a result. I call this far too “frequent”.
At Evolved Software Studios, we have written crucial medical software used to check blood transfusions. And a messaging system more complex than verifications to assist in the diagnosis of eye diseases. We’ve even worked on a project for the Ministry of Defence. The failure rate in these industries of even 0.2% would mean deaths and we wouldn’t get paid. So, why when we report to HM Revenue & Customs - daily - that our customers are facing damaging their supply chain, do we have to wait (three weeks and counting) and do our customers tax queries not get treated with the same degree of care?
What about my evidence?
Well, this is a blog and I don’t want it to be too boring. Suffice to say that on the 18th July 2007, one of our customers provided us with a telephone verification reference number, and confirmed the data in the XML file output as being identical to the data used to verify a subcontractor over the phone. Online was unmatched, telephone was matched. Data provided to HMRC turns out to have absolutely no reason why an unmatched result should be returned.
I have my ideas as to why two different results were returned. Because there are two different front-end / business process / business rules; systems.
Anecdotally, it happens frequently to almost all customers in some way or another. Subcontractors may not have the correct name (or may enter nicknames instead of registered names), or may use the trading name field, instead of the name fields. Either way, if you’re using the online services - unmatched. If you telephone - matched. If you happen to call the phone verification service, you’ll get to speak to a human being who isn’t going to berate you for talking in lowercase, or getting the surname or forename the wrong way around, or using a nickname. “Mike”, oh, you mean “Michael?”, yes, he’s net 20%.. unmatched you say? nooo, computer says 20%”, says the proverbial computer operator…
When did someone in a call center last say to you, “Sorry. Call Terminated. You spoke in lower case.”? Or how about this, “Please provide everything you know about the customer, after the tone…. “, “Sorry, you said something that we didn’t quite expect. Unmatched. Call Terminated.”. Of course not, that would be silly! So why do we code our systems like this? The cynical would say that HM Revenue & Customs want you to be unmatched. Oh to suggest such a thing would be unkind.
Online, if your data set isn’t right - computer says no (unmatched). If you use a Contractor ERP, CRM or other solution, you are likely to hold a LOT of information on your subcontractors. Over and beyond the minimum data set of a National Insurance Number and a name. God forbid if, in your carelessness, you spelt the name wrong or provided a bit too much information - you’ve dug a hole for yourself for the online systems. We have in the past, recommended that our customers stop using so much data - perhaps stripping out addresses, trading names, telephone number etc. Going back to grass roots National Insurance Number, and a name. That usually always works. If you have more than that information in your database, you might be stinging your subcontractors out of their correct tax treatment status.
Of course, we know what works in practice, because we have the experimental, empirical evidence. I have been asking for the XSLT, or the business rules. The specification HM Revenue & Customs had written for Cap Gemini. Someone somewhere, is a software contractor, much like I or one of my colleagues - working on this system. Expressing the search criterion as a mathematical expression. These rules are known, but they are top secret… shhhh, HM Revenue & Customs don’t want you to know how they match people….
Waffling aside, I have many more examples, spanning several contractors. Many of whom have angrily told me that the new CIS helpline has told them to “speak to their vendors” or “check the software user manual”. I could spend all day working on the XML, playing trial and error on the live system with one of our customers live tax credentials - but we’re not allowed access to the live system, so how can we help any customer who has a query regarding live data? We simply contact HM Revenue & Customs with the query, and wait to be ignored. The anonymous “spokesman”, speaking from an assumed protected position of civil servanthood states that all the discrepancies are due to different data being provided on the phone as to online. This begs the question, why is different data being asked for then? Why, if the two systems should be the same, are the business processes that rule them - not?
Until this point, I have been advising our customers with a positive angle, saying that the phone verification service is better than the online one, since a human on the other end of a telephone can assist in tracking down a subcontractor. But as the writer of the article points out - there is absolutely no reason why any contractor should do this. Sure, a small contractor wanting to look after their supply chain might take exception to an unmatched response, phoning the revenue for advice - but what about a main contractor with THOUSANDS of subcontractors, whose systems are fully automated?
I assert that the phone system provides a “buffer” which allows for a larger degree of matching error than the online system - which is very tight. HM Revenue & Customs run two completely different systems for online and offline verification, regardless of the spin that you might hear from their “spokesman”. Either they should be telling customers who call - “sorry, you gave me an incorrect national insurance number. This person is unmatched. Deduct 30%. Computer says no. Goodbye.” - OR - the online matching system should work in a more flexible way, allowing for the same degree of error (perhaps allowing 3 out of 4 fields to be matched correctly = matched).
What could cause a known subcontractor to be returned unmatched then?
The trouble is even as a software development house, we are not priviledged with the information on how things work from HM Revenue & Customs side. Quite often, they don’t even know (I had a discussion with them last month on lock out periods, which turned out to not exist). It’s not any individual’s fault, but some documentation would be nice to add to the pile. At least it could give us something to tell our customers when it looks like our software isn’t “matching” records correctly.
Since April 2007, here is what we have learned;
For every subcontractor undergoing verification:
-
If HM Revenue & Customs have a National Insurance Number for the subcontractor and you don’t provide it - unmatched (this rule may not apply on the phone verification service though)
-
If HM Revenue & Customs have a different UTR or National Insurance Number to yours - unmatched (make sure your data is 100% correct before making verifications)
-
There is a completely random chance that your verification (or monthly return) will contain something that makes the process on the HM Revenue & Customs server fall over. You won’t know if this is you until you try. This is caused by something in one of your subcontractor records that is perfectly acceptable, but HM Revenue & Customs can’t handle it. Call it bad testing if you like, I call it fustrating when users are logging tickets with us saying “your software doesn’t work, it’s been waiting a week for a reply for my verifications/monthly return”. The trick we recommend to customers is to isolate the subcontractor record by verifying alphabetically in batches. If you don’t get a response, halve your batch and try again. Try all the subcontractors with a trading name starting with “A’s” and “B’s” together. If it doesn’t work, just try “A’s”. If you have tens of thousands of subcontractors, you’re going to struggle. (To be fair, we haven’t had a report of this in a couple of weeks now, is it fixed? Who knows. HM Revenue & Customs don’t publish a version or change log)
-
If you’re getting unmatched on a subcontractor, try reducing the amount of information you hold about them. Perhaps erase their address, or erase their UTR from your records. Sounds daft, doens’t it? But it might work. Remember, you are partaking in a glorious multiple-choice get-it-wrong-and-you’re-unmatched quiz. Think of it like Jeopardy. The less “answers” you give the revenue, the less likelyhood you’re going get it wrong and accidentally trip the unmatched wire.
-
If you phone for a verification, you are going to get a better class response than if you go online. Simple. Computers do exactly what they are told, if you do an online verification HM Revenue & Customs are matching letter for letter, number for number. If you go on the phone you will get a person who will work with you on getting someone verified. The human in the loop is not following the same rules as the online service. This is, in a way, a good thing. A human will always use their own intelligence to match the fields and see if they can find who you are looking for. We have never heard of the phone service coming back unmatched where software matches.
-
Nicknames, Pseudoymns
-
Putting personal names into Trading Names (according to discussions with HMRC, this shouldn’t cause an unmatched… but it does - trust me)
These are just undocumented examples which we have learned from feedback from our great customers. We have tested and seen these, and confirmed them with HM Revenue & Customs. I’ve asked if there are any more, but who knows? Maybe if “the system” just doesn’t like you, you’ll get unmatched too. Come on HMRC, if you really want to stop rumours why not join the rest of the world in adopting some proper science rather than contorted spin? I’m talking about standards, fully testable evidence and no-nonsense documentation. Even the new CIS helpline runs off scripts. Scripts they won’t publish. Why not? Surely if these hidden business rules were made clear and those helpline scripts published we would, as a software house be able to advise customers directly.
After all, customers call us to complain after being told to “contact the vendor who supplied your software”, presumably by a script-reading temp in a “computer says no” voice.
It is tiring being blamed for faults in a third party online service that really should have been written by an innovative private software company
However, I feel more fustration on behalf of those subcontractors, moving from site to site - working for large contractors - who - may fall foul of one of the “unmatched” bombs in the proverbial minefield of new CIS online.
It’s 23:57, I’ve been working on these issues all day, and I haven’t proof read my article. I hope you, dear reader, can see past me waxing lyrical about the inane and boorish comments from HM Revenue & Customs to date and gain some value.
If, in my ramblings, I have managed to save one family business from being unfairly cash-flow punished, it would have been worth it. As ever, this is my opinion, feel free to leave comments.




