Email updates

Keep up to date with the latest news and content from Critical Care and BioMed Central.

Highly Accessed Review

Clinical review: Outreach – a strategy for improving the care of the acutely ill hospitalized patient

Debby Bright1, Wendy Walker2 and Julian Bion3*

Author Affiliations

1 Nurse Consultant, Critical Care/Outreach, University Hospital Birmingham NHS Trust, Birmingham, UK

2 Nurse Consultant, Critical Care/Outreach, Mid Staffordshire General Hospitals NHS Trust, Stafford, UK

3 Reader in Intensive Care Medicine, Birmingham University, Birmingham, UK

For all author emails, please log on.

Critical Care 2004, 8:33-40  doi:10.1186/cc2377


See related Commentary: http://ccforum.com/content/8/1/9


The electronic version of this article is the complete one and can be found online at:


Published:6 October 2003

© 2004 BioMed Central Ltd

Abstract

We examined the literature relating to the safe care of acutely ill hospitalized patients, and found that there are substantial opportunities for improvement. Recent research suggests substantial benefit may be obtained by systems of outreach care that facilitate better integration, co-ordination, collaboration and continuity of multidisciplinary care. Herein we review the various approaches that are being adopted, and suggest the need for continuing evaluation of these systems as they are introduced into different health care systems.

Keywords:
acute pain team; cardiopulmonary resuscitation; critical care; critical illness; patient at risk; suboptimal care

Introduction

Health care providers in many countries are increasingly aware that quality of care can be improved by measures to reduce errors. Evidence suggests that the greatest opportunities for improvement may be in the management of the acutely ill hospitalized patient, where uncertainty, urgency and lack of integration substantially increase the risk of errors leadinf to adverse outcomes. Different approaches to this problem have evolved, including hospitalists in the USA, medical emergency teams in Australia, and outreach care in the UK. Critical care has a central role to play in all three developments, which share the common aim of improving the safe care of acutely ill patients as they travel through the health care system. We will review the background, methods, roles and benefits of these various systems which we group under the heading of 'outreach' care.

Method

We focused on identifying research publications that examined ways of improving the integration of critical care with acute care services as a means of improving the safe care of acutely ill hospitalized patients. Publications were initially identified by an electronic search of Medline and Cinahl, and the cited references provided additional material. The initial date range searched was 1995–2003 to ensure that current research and up to date literature was reviewed. However, this produced only a limited number of references, and the time period was therefore extended to 1990. Keywords searched singularly and in combination were 'acute pain team', 'suboptimal care', 'patient at risk', 'critical illness' and 'cardiopulmonary resuscitation'. Only English language references were included in the analysis.

Background

Trends in hospital care

Hospitals are becoming increasingly complex environments because of developments in medical technology, more potent treatments, and an ageing and dependent population of patients. The proportion of emergency admissions continues to rise in most countries [1], whereas the stock of hospital beds has fallen. Combined with political demands for cost containment, this has resulted in shorter hospital stays, and increased bed occupancy and throughput [2]. At the same time there has been a trend toward greater transparency in decision making, rising public expectations, and improved public access to information about quality of care and outcomes from medical interventions. These changes have coincided with increasing difficulty with the recruitment and retention of trained nurses [3], and constraints on doctors' hours of work. The implementation of the European Working Time Directive [4], and similar trends in the USA [5], means that proportionately fewer staff are available to manage this increased workload, particularly the out-of-hours and emergency elements. Shorter training times reduce the expertise acquired through apprenticeship. The net effect is that sicker patients are receiving care from fewer and less experienced staff.

Error and quality in health care

These pressures have been accompanied by a growing awareness of the problem of error in health care and an exponential increase in litigation. The much quoted Institute of Medicine report 'To Err is Human' [6] estimated that between 44 000 and 98 000 patients die each year in the USA as a result of preventable clinical errors. Studies in Australia and the UK suggest that around 10–16% of hospitalized patients experience an adverse event related to clinical care, with a mortality rate in these patients of 5–8%, and overall financial costs in the range US $4.7–29 billion [7-9]. Clinical error is now widely recognized as a systems problem; that is, adverse events affecting individual patients are usually caused by a sequence of events in the macro- and micro-environment that involve deficiencies in the structure and organization of health care, and are not simply a consequence of human error by the responsible clinician who is the terminal link in the chain. To improve safety and quality in health care requires a systems approach in which all participants – politicians, administrators and health care professionals – assume responsibility for patient outcomes. This ambitious task requires focusing of efforts on those patients most at risk.

Identifying at-risk populations

Acutely ill patients in general

The risk of error and adverse outcomes would appear to be higher in the context of acute and emergency care, for example in emergency departments [7] or in general medical (rather than elective surgical) admissions [8]. The elderly are more susceptible [7]; they are also more likely to be admitted as emergencies and exposed to emergency surgery [10]. Inexperienced clinicians and unsupervised trainees (who often deliver first-line care out-of-hours) have a higher error rate [11,12]. The risk for an adverse event increases by approximately 6% per day for patients admitted with emergency conditions [13], and is much increased in severely ill patients who undergo life-saving invasive interventions [14]. Discontinuities in care [15] created by shift working or poor information transfer contribute to error by failing to recognize trends in a deteriorating patient's condition.

Postoperative patients

In the UK the 1993 National Confidential Enquiry into Perioperative Deaths showed that two thirds of perioperative deaths occurred 3 or more days after surgery when the patient had been returned to the ward. The majority of these deaths were from cardiorespiratory complications, and many were considered preventable by earlier identification and treatment [16]. The 1999 report [17] analyzed deaths within 30 days of a surgical procedure in elderly patients (>90 years), and found that suboptimal fluid management was a major cause of serious postoperative morbidity and mortality in this group. It recommended more accurate monitoring and recording of fluid balance and earlier recognition and correction of problems as a means of reducing the incidence of postoperative complications. The report also identified deficiencies in multidisciplinary care, despite the high incidence of comorbid disease in these elderly patients, and recommended more collaborative working between surgeons, anaesthetists and physicians with expertise in the care of the elderly.

This type of audit based on a large observational database is essential for identifying current practice and opportunities for improvement. However, recommendations were based on peer review and data from questionnaires provided by assessors who were unblinded to clinical outcomes, examining only those patients who died – there are no denominator data.

Cardiopulmonary arrest

Hospitalized patients who undergo cardiopulmonary resuscitation commonly exhibit premonitory signs and symptoms many hours before the cardiac arrest [18-21]. Schein and coworkers [18] studied 64 patients following cardiac arrest, and reported that 84% of vital signs charts showed an acute deterioration in the patient's condition prior to arrest. Franklin and Mathew [20] examined the case notes of 150 consecutive patients who had suffered a cardiac arrest on a general ward, and found documented prior clinical deterioration in 99 (66%). A common finding was the failure of the nurse to notify a physician of deterioration in the patient's condition.

The interface with critical care

Critical illness increases the opportunity for clinical error [22,23], and this is related at least in part to the complexity of diseases, the multiplicity of therapies, frequent invasive interventions and, within the intensive care unit (ICU), the intensity of monitoring and observation, which may paradoxically increase the apparent error rate in this environment simply by improved detection. Iatrogenic complications are a common cause for ICU admission [24], and suboptimal care before referral to intensive care is associated with a markedly increased mortality [25]. Premature discharge from intensive care of patients recovering from critical illness is also associated with a markedly increased hospital mortality [26], supporting the view that organizational aspects of clinical care profoundly influence patient outcomes [27]. Common errors include lack of attention to detail, poor communication, failures of organization, lack of knowledge, failure to appreciate clinical urgency, insufficient supervision and failure to seek advice.

Treatment limitation decisions, futility, and end of life care

Studies in the USA and Europe have demonstrated considerable diversity of practice and opportunities for improving autonomy, patient centred decision making, and quality of end-of-life care [28,29]. The Study to Understand Prognosis and Preferences for Outcomes and Risks of Treatment in the USA [29] demonstrated that 31% of the cohort of patients admitted to intensive care would have preferred not to be resuscitated, but that clinicians were aware of this preference in only 47% of the subset and in half it had not been documented. Aarons and Beeching [30] surveyed the use of 'do not resuscitate' orders in a community hospital in the UK and suggested that end-of-life care of dying patients and their families in hospital could be substantially improved in terms of symptom relief, communication and respect for the patients' wishes. They also concluded that poor decision making by health care workers could be improved by education. One consequence of a lack of communication between staff and a reluctance to discuss these difficult issues with patients and families is the inappropriate resuscitation and subsequent admission to the ICU of patients for whom further intervention would be futile and add to the burden of suffering.

A more appropriate approach to management of acutely ill patients at risk for critical illness or cardiac arrest would be to prevent these complications, or agree treatment goals and limitations, by earlier recognition of simple warning signs. We consider the various approaches that are being adopted below.

Systems for earlier recognition and management of patients at risk

The problems described above require a systems approach to improving the safe care of the acutely ill hospitalized patient. The USA, the UK, Australia, Canada and Denmark are instituting national systems for improving patient safety [31-33]. Within this general framework, three countries have specifically identified the need to improve the care of acutely ill patients. In the USA the Leapfrog Group [34] has recommended that ICUs be managed by intensivists – doctors specifically accredited in critical care medicine – while in a parallel development many hospitals are appointing 'specialist generalists' ('hospitalists') to provide inpatient care on the wards [35]. Australia has promoted the establishment of medical emergency teams (METs) led by doctors as an alternative to cardiac arrest teams [36,37]; and the UK has implemented the recommendation of the expert group report 'Comprehensive Critical Care' [38] to establish multidisciplinary outreach care. All these developments are based on the concept of earlier intervention by people with appropriate knowledge and skills in managing acutely ill patients. Is this concept valid, and which model is the best?

Structures and processes for early intervention

In the UK a survey of intensive care facilities found that, in 94% of the units questioned, staff regularly visited wards in response to requests for advice from medical and nursing members of the admitting team [39], demonstrating that this is clearly an important role for intensive care staff. However, there is little information describing the experiences and perspectives of ward based staff who care for acutely ill patients outside the intensive care environment. Gibson [40] found that ward staff often lacked confidence and felt ill prepared to deal with acutely ill unstable patients, and that they experienced increased stress and anxiety. Such emotions are unlikely to enhance staff retention or reduce sickness rates. It therefore makes sense to put in place systems that improve the support not only of sick patients but also of the staff responsible for their care, and that reduce discontinuities in clinical care. The key to this is empowerment through adequate resourcing and training, and simple methods of clinical monitoring. Three models are currently employed: hospitalists in the USA, the MET in Australia, and outreach care in the UK.

Hospitalists

Hospitalists are internists who specialize in acute hospital medicine. This new speciality has appeared in the USA during the past 8 years in response to perceived difficulties with primary care clinicians maintaining continuity of care for their patients admitted to hospital. Currently at around 5000, their numbers are expected to increase rapidly. Hospitalists are usually salaried employees of managed care organizations, which favour their development as a means of reducing costs and duration of hospital stay [41,42]. The training of hospitalists is rooted primarily in internal medicine, but there is no national core curriculum. They do not appear to have responsibility for surgical patients, and therefore cannot be considered generalists in the sense of dealing with all acutely ill patients. The relationship between hospitalists and intensivists has not been defined [43], although there clearly are opportunities for interaction. Hospitalists occupy a role that is close to that of the general physician in UK hospitals, except that the latter group often have a subspeciality.

This model is suited to the system of care in the USA, where primary care physicians often have continuing responsibility for inpatient care. It might also be of value to other health care systems in which increasing specialization is creating a need for generalist acute care clinicians in hospital practice.

Acute pain teams

A joint expert committee report from a Royal College of Surgeons and College of Anaesthetists working party [44] reviewed the evidence related to postoperative pain management and recommended the establishment of an acute pain service in all major hospitals. However, the Audit Commission reported in 1997 [45] that only 57% of hospitals in the UK had established a pain service. The situation had improved by 2000 when the Clinical Standards Advisory Group found that 88% of responding UK hospitals had set up an acute pain service, although in some cases this was only a token service. The 1990 working party did not describe a model for the ideal acute pain team [44], and this has led to many inconsistencies in the provision of pain management throughout the UK. Acute pain teams ensure adequate postoperative pain relief by supporting and educating ward staff [46]. Concerns have been expressed that they may de-skill ward nurses [47], although there is no research evidence to support this view.

Because more complicated surgery is performed in older patients, who have more comorbidities, we can expect to see an increase in the number of life-threatening postoperative complications [16]. Surgical patients make up 60–70% of the workload of ICUs in the UK [48,49]. It has been suggested that the role of acute pain teams should be extended to identify nonpain problems in patients, and liaise with other specialties to manage them [46]. Some acute pain services have already extended their role from pain management to include fluid balance, oxygen therapy, management of nausea and vomiting, and anticoagulant prophylaxis [50]. This role extension requires proper training in the management of acutely ill patients and an understanding of the interface between acute medicine and intensive care.

Medical emergency teams

The concept of a better integrated, multidisciplinary approach to postoperative care [51,52] has been extended to other groups of patients in the form of specific groups or teams of clinicians, usually centred on the ICU. Examples of this evolution include postoperative care teams [53], patient at risk teams [54] and METs [36,48,52]. All suggest that the introduction of such teams to identify and manage complications on the ward might prevent unnecessary admissions to the ICU and reduce morbidity and mortality.

The team based approach uses calling criteria based on abnormal clinical or physiological variables, specific conditions, or patients causing concern to ward staff. The research evidence to support the validity of these criteria is limited by the practical and ethical difficulties of conducting randomized controlled trials in the clinical environment. Although postoperative care teams provide additional support, expertise and equipment for postoperative patients [54], and similar approaches could improve suboptimal ward care in general [25], there are no a priori definitions of inadequate care that have been prospectively calibrated against outcome in this context. However, pragmatic studies of the impact of METs indicate a reduction in cardiac arrest rates and in the use of intensive care resources for cardiac arrest survivors [55,56].

Critical care outreach

'Outreach' care is a systems approach for identifying and managing patients at risk of critical illness through collaborative care and education. Rather than providing a service through an external group, it aims to empower ward staff by offering them regular support, usually led by critical care trained nurses visiting the wards, with the facility to call on more expert assistance if required. Currently, critical care is seen as occurring within a defined environment (the ICU) and patients must achieve a certain level of severity of illness to merit admission. Outreach services facilitate a more flexible approach that is based on the needs of the patients and the skills and abilities of the ward staff.

Both the Audit Commission [57] and the Department of Health working party report 'Comprehensive Critical Care' [55] supported the development of outreach care as a means of improving the care of acutely ill patients in hospital wards. The latter report identified three goals for a critical care outreach team. The first was to identify patients at risk for critical illness and either prevent their admission to ICU by timely interventions at a ward level or ensure early appropriate admission to ICU. The second was to facilitate timely and safe discharge from intensive care by following up patients discharged to the ward. The third was to share ICU skills with ward staff. Given the wide variations in hospital size, specialties, staff expertise and skills, the Department of Health report did not prescribe a standard structure for achieving these three goals. The development of outreach services should not be taken in isolation from other critical care initiatives and should be part of an integrated, multidisciplinary, hospital-wide delivery of critical care services that improves liaison between intensive, high dependency and ward care [56].

The majority of UK centres have nurse led outreach systems, supported by critical care doctors with sessional recognition for this service. However, the aim of outreach is to diffuse skills across many disciplines, and to enhance collaborative care. Many professional groups can therefore contribute to this approach, including physiotherapists and nutritionists as well as physicians. Studies are needed to evaluate the efficacy of this development, but current experience indicates a strongly favourable response from ward based staff. Standards for the development of outreach care are now available [58].

Identifying the patient at risk – scoring systems for decision support

Traditionally, the process of identifying critically ill and deteriorating patients has relied on the clinical intuition of staff. The value of experienced clinical judgement is well recognized [36,54,59,60], but given the trend toward shorter training times and reduced hours of work in the clinical environment, objective systems are becoming increasingly important because inexperienced practitioners may fail to recognize impending critical illness and the need for assistance [61].

There are several such systems that utilize combinations of physiological variables as indicators of risk [36,54,56,62-66]. A summary of component variables is given in Table 1. Hodgetts and coworkers [67] analyzed factors that predicted risk for cardiac arrest and could therefore be used as triggers to call for help ('activation criteria'). Variables with predictive capacity included chest pain, staff concern, systolic blood pressure, oximetry, pulse and respiratory rate, and temperature. The choice of vital signs is necessarily constrained to those that are easy to record in the ward environment. More finesse may be achieved with the inclusion of laboratory tests such as serum electrolytes, blood sugar and acid-base analysis, or the inclusion of diagnosis, but the problem with this approach is that recording vital signs is often omitted or inaccurate [17,54], and the greater the degree of complexity, the more likely it is that errors or omissions will occur. Scoring systems for use in ordinary wards must be simple, and should direct attention to patients who need more intensive observation; they should be a trigger for investigation, not a precise tool for predicting individual patient outcomes. Thus, although physiological abnormalities may be unreliable predictors of the need for intensive care admission, they remain important stimuli for empowering staff to call for assistance in improving simple aspects of care of acutely ill patients.

Table 1. Variables used by different scoring systems to trigger referral to a critical care service

Does earlier intervention improve outcome?

It may seem unnecessarily argumentative to suggest that something that is so evidently 'good' requires evaluation. Is it not self-evident that the earlier a life-threatening disease process is identified and treated, the better? This may be so, but complex systems – of which the acutely ill patient is one example – demonstrate sensitivity to initial conditions; that is, the outcome may be more difficult to predict with earlier application of an intervention. The outcome from cardiopulmonary resuscitation is well defined – a survival rate of around 10–15%, with death usually occurring when resuscitation attempts are discontinued. Is it not possible that earlier intervention that prevents cardiac arrest might result in delayed death following prolonged organ system support in the ICU, with the attendant suffering that this may cause? What is the cost–benefit of implementing the different models of care? Who will manage the process of discussing treatment goals or limitations with patients, and what do patients themselves feel about it?

Physiological goals

The literature relating to preoperative optimization of systemic oxygen delivery in high-risk surgical patients suggests that early intervention is beneficial [68-72]. However, a recent large-scale study [73] conducted in surgical patients did not confirm this in terms of benefit from goal-directed therapy guided by pulmonary artery catheterization, perhaps because patients in the control group were already being optimally managed (and experienced a low overall mortality) as a result of improvements in clinical practice derived from earlier research.

In critically ill septic patients, early intervention to optimize oxygen delivery with fluid resuscitation, vasoactive drugs and respiratory support appears to reduce mortality [74], whereas similar interventions applied later in the course of illness do not [75-77]. It seems reasonable to conclude that using fluids and supplemental oxygen to optimize circulating volume, cardiac output and systemic oxygen delivery as early as possible in acutely ill hospitalized patients will tend to reduce the incidence and severity of organ dysfunction related to a systemic oxygen debt. These simple measures may need to be supplemented later by more complex interventions, but the ability to manage the initial phase of preventive care should be within the ability of most health care staff.

Clinical outcomes

Early intervention may reduce morbidity and mortality, but it is also possible that the earlier application of supportive treatment could contribute additional burdens. Buist and colleagues [62] demonstrated that the introduction of a MET contributed to a reduction in ward cardiac arrest rates, but this was also associated with an increase in emergency admissions to intensive care with no significant change in ICU mortality rates. This suggests that for some patients earlier intervention may have the effect of shifting the burden of mortality from the ward to the ICU, replacing a 'cheap' death with an expensive one. More recently, however, Bellomo and colleagues [63] also demonstrated a marked reduction in cardiac arrest rates associated with the introduction of a MET, and a parallel reduction in the use of intensive care resources on cardiac arrest survivors. It seems likely, therefore, that hospitals with high ward based cardiac arrest rates may well benefit from the introduction of systems aimed at identifying and managing sick patients earlier. Further multicentre studies from Australia are awaited.

Autonomy and treatment limitation decisions

In an ideal world we would all possess clear advance directives giving guidance on how we would wish to be treated given differing circumstances. However, treatment preferences will not be static over time and are likely to be influenced by circumstances and the provision of information. How do patients respond to opportunities to discuss treatment preferences? Studies conducted in elective or out-patient settings demonstrate that many patients wish to be involved in decisions about treatment goals and intensity. They also demonstrate that the accuracy of information substantially alters preferences for resuscitation [78]. In the acute care context, however, there is considerable variability in clinical practice; moreover, many patients may not wish to discuss their preferences [79], even though this results in inappropriate treatment decisions [80]. It is clear that discussions about treatment preferences must be conducted with sensitivity by staff with appropriate experience and training, who have had an opportunity to develop a relationship of trust with the patient. This mandates a collaborative approach between the various medical and nursing teams, the patient and the family. Early intervention may buy time for these complex discussions to take place and an appropriate decision to be made.

Changing behaviour through education and training

The key to improving safe care of acutely ill hospitalized patients is through team working and education, combined with improvements in resources for integrated delivery of care. In accident and emergency care, team based working reduces clinical error rates and enhances overall quality of care [81,82], and the principles of crew resource management drawn from aviation have important messages for clinical practice in this respect, by empowering all members of the team to make contributions to safety [83]. To achieve this we must incorporate team based attitudes in medical education, starting at undergraduate level and following this through into speciality training so that there is more overlap between disciplines than is currently the case. A competency based core curriculum for acute care that incorporates education in patient safety is essential. This process has started in intensive care medicine [84], and it is hoped that other disciplines will follow.

Personal responsibility and continuity of care are important features of quality care, and one of the challenges of implementing outreach is that it may encourage the attitude that someone else is responsible for the patient, and thus disem-power and de-skill ward staff [85]. Team working and continuity of care may be secured through the development of collaboratively produced guidelines or protocols that seek to support and guide the interaction between ward and outreach staff. Outreach staff should also recognize the limitations of their own expertise. Education is a key element in outreach activities, and is a two-way process that requires sharing of expertise, collaborative support, and blurring of traditional boundaries [86]. Important attitudinal attributes of outreach staff must therefore include the capacity to teach, learn from, and support other clinicians, sometimes under difficult circumstances.

Conclusion

There are substantial opportunities for improving the safety and quality of care delivered to acutely ill hospitalized patients. The methods which are adopted will vary according to local circumstance, but common elements include the need for better integration of care across disciplines and systems for earlier identification of patients at risk, and we refer to these as 'outreach' care. We do not yet know which of these various approaches will best improve patient outcomes, and there is a need for prospective studies in this area which take into account the difficulties of using randomization and controls, and which employ long-term follow-up. METs appear to reduce the incidence of cardiac arrests in ordinary wards, and consequential use of scarce intensive care resources. Outreach-based systems which support and educate ward-based staff in delivering clinical care appear to have achieved a high degree of acceptance in the UK. Health care managers need to work closely with clinicians to introduce these methods of team-working into hospital practice, while evaluating their effectiveness.

Competing interests

None declared.

Abbreviations

ICU = intensive care unit; MET = medical emergency team.

References

  1. World Health Organization: World Health Organization report: emergency medical services. [http://www.who.dk/emergservices] webcite

  2. Organisation for Economic Co-operation and Development (OECD): A comparative analysis of 29 OECD countries. [http://www.oecd.org] webcite

  3. Buchan J: Global nursing shortages.

    BMJ 2002, 324:751-752. PubMed Abstract | Publisher Full Text OpenURL

  4. UK Department of Health: Guidance on implementing the European working time directive for doctors in training. [http://www.doh.gov.uk/workingtime/ewtdguidance.htm] webcite

  5. Philibert I, Friedmann P, Williams WT: New requirements for resident duty hours.

    JAMA 2002, 288:1112-1114. PubMed Abstract | Publisher Full Text OpenURL

  6. Kohn LT, Corrigan JM, Donaldson MS, eds: To Err is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000. OpenURL

  7. Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby l, Hamilton JD: The Quality in Australian Health Care Study.

    Med J Aust 1995, 163:458-471. PubMed Abstract OpenURL

  8. Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review.

    BMJ 2001, 322:517-519. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. National Audit Office: The management and control of hospital acquired infection in acute NHS trusts in England. [http://www.nao.gov.uk/publications/nao_reports/9900230.pdf] webcite

    2000.

  10. Bellomo R, Goldsmith D: Postoperative serious adverse events in a teaching hospital: a prospective study.

    Med J Aust 2002, 176:216-218. PubMed Abstract | Publisher Full Text OpenURL

  11. Wu AW, Folkman S, McPhee SJ, Lo B: Do house officers learn from their mistakes?

    JAMA 1991, 265:2089-2094. PubMed Abstract | Publisher Full Text OpenURL

  12. Lesar TS, Briceland LL, Delcoure K, Parmalee CJ, Masta-Gornic V, Pohl H: Medication prescribing errors in a teaching hospital.

    JAMA 1990, 263:2329-2334. PubMed Abstract | Publisher Full Text OpenURL

  13. Andrews LB, Stocking C, Krizek T, Gottlieb L, Krizek C, Vargish T, Siegler M: An alternative strategy for studying adverse events in medical care.

    Lancet 1997, 349:309-313. PubMed Abstract | Publisher Full Text OpenURL

  14. Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients.

    N Engl J Med 1991, 324:370-376. PubMed Abstract OpenURL

  15. Cook RI, Render M, Woods DD: Gaps in the continuity of care and progress on patient safety.

    BMJ 2000, 320:791-794. PubMed Abstract | Publisher Full Text OpenURL

  16. Gamil M, Fanning A: The first 24 hours after surgery. A study of complications after 2153 consecutive operations.

    Anaesthesia 1991, 46:712-715. PubMed Abstract OpenURL

  17. NCPOD: National Confidential Enquiry into Perioperative Deaths. London, UK: HMSO; 1999:712-715. OpenURL

  18. Schein R, Hazday N, Pena M, Bradley H, Ruben B, Sprung CL: Clinical antecedents to in-hospital cardiopulmonary arrest.

    Chest 1990, 98:1388-1391. PubMed Abstract OpenURL

  19. Garrard C, Young D: Suboptimal care of patients before admission to intensive care.

    BMJ 1998, 316:1841-1842. PubMed Abstract OpenURL

  20. Franklin C, Mathew J: Developing strategies to prevent in hospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event.

    Crit Care Med 1994, 22:244-247. PubMed Abstract OpenURL

  21. McGloin H, Adam S, Singer M: The quality of pre-ICU care influences outcome of patients admitted from the ward.

    Clin Intensive Care 1997, 8:104. OpenURL

  22. Giraud T, Dhainaut JF, Vaxelaire JF, Joseph T, Journois D, Bleichner G, Sollet JP, Chevret S, Monsallier JF: Iatrogenic complications in adult intensive care units: a prospective two-center study.

    Crit Care Med 1993, 21:40-51. PubMed Abstract OpenURL

  23. Donchin Y, Gopher D, Olin M, Badihi Y, Biesky M, Sprung CL, Pizov R, Cotev S: A look into the nature and causes of human errors in the intensive care unit.

    Crit Care Med 1995, 23:294-300. PubMed Abstract | Publisher Full Text OpenURL

  24. Darchy B, Le Miere E, Figueredo B, Bavoux E, Domart Y: Iatrogenic diseases as a reason for admission to the intensive care unit: incidence, causes, and consequences.

    Arch Intern Med 1999, 159:71-78. PubMed Abstract | Publisher Full Text OpenURL

  25. McQuillan P, Pilkington S, Allan A, Taylor B, Short A, Morgan G, Nielsen M, Barrett D, Smith G, Collins CH: Confidential inquiry into quality of care before admission to intensive care.

    BMJ 1998, 316:1853-1858. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Goldfrad C, Rowan K: Consequences of discharges from intensive care at night.

    Lancet 2000, 355:1138-1142. PubMed Abstract | Publisher Full Text OpenURL

  27. Pronovost PJ, Jenckes MW, Dorman T, Garrett E, Breslow MJ, Rosenfeld BA, Lipsett PA, Bass E: Organizational characteristics of intensive care units related to outcomes of abdominal aortic surgery.

    JAMA 1999, 281:1310-1317. PubMed Abstract | Publisher Full Text OpenURL

  28. Vincent JL: European attitudes to wards ethical problems in intensive care medicine: results of an ethical questionnaire.

    Intensive Care Med 1990, 322:309-315. OpenURL

  29. Anonymous: A controlled trial to improve care for seriously ill hospitalized patients. The Study to Understand Prognosis and Preferences for Outcomes and Risks of Treatment. The SUPPORT Principal Investigators.

    JAMA 1999, 274:1591-1598. OpenURL

  30. Aarons EJ, Beeching NJ: Survey of 'do not resuscitate' orders in a district general hospital.

    BMJ 1991, 303:1504-1506. PubMed Abstract OpenURL

  31. Department of Health: An organisation with a memory. [http://www.doh.gov.uk/orgmemreport] webcite

    2000.

  32. Shaw C, Coles J: Reporting of Adverse Clinical Incidents: International Views and Experience. London: CASPE Research; 2001. OpenURL

  33. Baker GR, Norton P: Patient safety and healthcare error in the Canadian healthcare system: a systematic review and analysis of leading practices in Canada with reference to key initiatives elsewhere. A report to Health Canada. [http://www.hc-sc.gc.ca/english/care/report/index.html] webcite

  34. The Leapfrog Group: Leapfrog patient safety standards (November). [http://www.leapfroggroup.org] webcite

    2000.

  35. Wachter RM, Goldman L: The emerging role of 'Hospitalists' in the American health care system.

    N Engl J Med 1996, 335:514-517. PubMed Abstract | Publisher Full Text OpenURL

  36. Lee A, Bishop G, Hillman KM, Daffurn K: The medical emergency team.

    Anaesth Intensive Care 1995, 23:183-186. PubMed Abstract | Publisher Full Text OpenURL

  37. Kerridge RK, Saul P: The medical emergency team, evidence-based medicine and ethics.

    Med J Aust 2003, 179:1-3. OpenURL

  38. O'Dea J, Pepperman M, Bion J: Comprehensive critical care: a national strategic framework in all but name.

    Intensive Care Med 2003, 29:1594. PubMed Abstract | Publisher Full Text OpenURL

  39. Audit Commission: Critical to Success. The Provision of Critical Care Services in England and Wales. London: Audit Commission; 1999. OpenURL

  40. Gibson J: Afraid of critical care?

    Nurs Stand 1996, 11:20. PubMed Abstract OpenURL

  41. Wachter RM, Goldman L: The emerging role of 'Hospitalists' in the American health care system.

    N Engl J Med 1996, 335:514-517. PubMed Abstract | Publisher Full Text OpenURL

  42. Auerbach AD, Nelson EA, Lindenauer PK, Pantilat SZ, Katz PP, Wachter RM: Physician attitudes toward and prevalence of the hospitalist model of care: results of a national survey.

    Am J Med 2000, 109:648-653. PubMed Abstract | Publisher Full Text OpenURL

  43. Pronovost P, Angus DC: Intensivist consultation and outcomes in critically ill patients.

    JAMA 2003, 289:986-987. PubMed Abstract | Publisher Full Text OpenURL

  44. The Royal College of Surgeons and Royal College of Anaesthetists: Commission on the Provision of Surgical Services. Report on the Working Party on Pain after Surgery. London: Royal College of Surgeons and Royal College of Anaesthetists; 1990. OpenURL

  45. Audit Commission: Pain after Surgery: Summary of Results from a National Survey. London: Audit Commission; 1997. OpenURL

  46. Haigh C: Acute pain management. An evaluation overview of the last decade.

    Nurse 2 Nurse 2000, 1:10-11. OpenURL

  47. Clinical Standards Advisory Group: Services for Patients with Pain. Oxford; Clinical Standards Advisory Group; 2000. OpenURL

  48. Cuthbertson BH, Webster NR: The role of the intensive care unit in the management of the critically ill surgical patient.

    J R Coll Surg Edinb 1999, 44:294-300. PubMed Abstract OpenURL

  49. Parker A, Wyatt R, Ridley S: Intensive care series; a crises of increasing expressed demand.

    Anaesthesia 1998, 53:113-120. PubMed Abstract | Publisher Full Text OpenURL

  50. Counsell DJ: The acute pain service: a model for outreach critical care.

    Anaesthesia 2001, 56:925-926. PubMed Abstract | Publisher Full Text OpenURL

  51. Wulf H, Schug S, Allvin R, Kehlet H: Postoperative patient management: how can we make progress?

    Acute Pain 1998, 1:32-44. OpenURL

  52. Lee A, Lum ME, O'Regan WJ, Hillman KM: Early postoperative emergencies requiring an intensive care team intervention.

    Anaesthesia 1998, 53:529-535. PubMed Abstract | Publisher Full Text OpenURL

  53. Goldhill DR: Introducing the postoperative care team [editorial].

    BMJ 1997, 314:389. PubMed Abstract | Publisher Full Text OpenURL

  54. Goldhill DR, Worthington L, Mulcahy A, Tarling M, Sumner A: The patient at risk team: identifying and managing seriously ill ward patients.

    Anaesthesia 1999, 54:853-860. PubMed Abstract | Publisher Full Text OpenURL

  55. Department of Health: Comprehensive Critical Care. London, UK: Department of Health; 2000. OpenURL

  56. Hickey C, Allen MJ: A critical care liaison service [abstract 650P].

    Br J Anaesth 1998, 81:650. OpenURL

  57. Audit Commission: Critical to Success. In The Provision of Critical Care Services in England and Wales. London, UK: Audit Commission; 1999. OpenURL

  58. Intensive Care Society: Guidelines for the Introduction of Outreach Services. London, UK: Intensive Care Society; 2002. OpenURL

  59. Edwards AT, Ng KJ, Shandall AA, Price-Thomas JM: The APACHE II severity of disease scoring system in predicting outcome on a surgical ITU.

    J R Coll Surg Edinb 1991, 36:37-40. PubMed Abstract OpenURL

  60. Cioffi J: Recognition of patients who require emergency assistance: a descriptive study.

    Heart Lung 2000, 29:262-268. PubMed Abstract | Publisher Full Text OpenURL

  61. Daffurn K, Lee A, Hillman KM, Bishop GF, Bauman A: Do nurses know when to summon emergency assistance?

    Intensive Crit Care Nurs 1994, 10:115-120. PubMed Abstract | Publisher Full Text OpenURL

  62. Buist MD, Moore GE, Bernard SA, Waxman BP, Anderson JN, Nguyen TU: Effects of medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study.

    BMJ 2002, 324:387-390. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  63. Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart G, Opdam H, Silvester W, Doolan L, Gutteridge G: A prospective before-and-after trial of a medical emergency team.

    MJA 2003, 179:1-3. OpenURL

  64. Morgan RJM, Williams F, Wright MM: An early warning scoring system for detecting developing critical illness.

    Clin Intensive Care 1997, 8:100. OpenURL

  65. Stenhouse C, Coates S, Tivey M, Allsop P, Parker T: Prospective evaluation of a modified Early Warning Score to aid earlier detection of patients developing critical illness on a surgical ward [abstract 663P].

    Br J Anaesth 2000, 84:663. OpenURL

  66. Coates S, Tivey M, Stenhouse CW, Allsop P: Introduction of a modified early warning score to surgical wards to improve detection of patients developing critical illness [abstract 41–42P].

    J Integrated Care 2000, 41-42. OpenURL

  67. Hodgetts TJ, Kenward G, Vlachonikolis IG, Payne S, Castle N: The identification of risk factors for cardiac arrest and formulation of activation criteria to alert a medical emergency team.

    Resuscitation 2002, 54:125-131. PubMed Abstract | Publisher Full Text OpenURL

  68. Boyd O, Grounds RM, Bennett ED: A randomised clinical trial of the effect of deliberate perioperative increase of oxygen delivery on mortality in high-risk surgical patients.

    JAMA 1993, 270:2699-2707. PubMed Abstract | Publisher Full Text OpenURL

  69. Wilson J, Woods I, Fawcett J, Whall R, Dibb W, Morris C, McManus E: Reducing the risk of major elective surgery: randomised controlled trial of preoperative optimisation of oxygen delivery.

    BMJ 1999, 318:1099-1103. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  70. Berlauk JF, Abrams JH, Gilmore IJ, O'Conner SR, Knighton DR, Cerra FB: Preoperative optimisation of cardiovascular hemo-dynamics improves outcome in peripheral vascular surgery.

    Ann Surg 1991, 214:289-297. PubMed Abstract OpenURL

  71. Sinclair S, James S, Singer M: Intraoperative intravascular volume optimisation and length of hospital stay after repair of proximal femoral fracture: randomised controlled trial.

    BMJ 1997, 315:909-912. PubMed Abstract | Publisher Full Text OpenURL

  72. Lobo SM, Salgado PF, Castillo VGT, Borim AA, Polachini CA, Palchetti JC, Brienzi SL, de Oliveira GG: Effects of maximizing oxygen delivery on morbidity and mortality in high-risk surgical patients.

    Crit Care Med 2000, 28:3396-3404. PubMed Abstract | Publisher Full Text OpenURL

  73. Sandham JD, Hull RD, Brant RF, Knox L, Pineo GF, Doig CJ, Laporta DP, Viner S, Passerini L, Devitt H, Kirby A, Jacka M, Canadian Critical Care Clinical Trials Group: A randomized, controlled trial of the use of pulmonaryartery catheters in high-risk surgical patients.

    N Engl J Med 2003, 348:5-14. PubMed Abstract | Publisher Full Text OpenURL

  74. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M, Early Goal-Directed Therapy Collaborative Group: Early goal-directed therapy in the treatment of severe sepsis and septic shock.

    N Eng J Med 2001, 345:1368-1377. Publisher Full Text OpenURL

  75. Hayes MA, Timmins AC, Yau EHS, Palazzo M, Hinds CJ, Watson D: Elevation of systemic oxygen delivery in the treatment of critically ill patients.

    N Engl J Med 1994, 330:1717-1722. PubMed Abstract | Publisher Full Text OpenURL

  76. Gattinoni L, Brazzi L, Pelosi P, Latini R, Tognoni G, Pesenti A, Fumagalli R: A trial of goal-oriented hemodynamic therapy in critically ill patients. SvO2 Collaborative Group.

    N Engl J Med 1995, 333:1025-1032. PubMed Abstract | Publisher Full Text OpenURL

  77. Heyland DK, Cook DJ, King D, Kernerman P, Brun-Buisson C: Maximizing oxygen delivery in critically ill patients: a methodologic appraisal of the evidence.

    Crit Care Med 1996, 24:517-524. PubMed Abstract | Publisher Full Text OpenURL

  78. Murphy DJ, Burrows D, Santilli RN, Kemp AW, Tenner S, Kreling B, Teno J: The influence of the probability of survival on patients' preferences regarding cardiopulmonary resuscitation.

    N Engl J Med 1994, 330:545-549. PubMed Abstract | Publisher Full Text OpenURL

  79. Hofmann JC, Wenger NS, Davis RB, Teno J, Connors AF, Desbiens N, Lynn J, Phillips RS, for the SUPPORT Investigators: Patient preferences for communication with physicians about end-of-life decisions.

    Ann Intern Med 1997, 127:1-12. PubMed Abstract | Publisher Full Text OpenURL

  80. The SUPPORT Principal Investigators: A controlled trial to improve care for seriously ill hospitalized patients. The Study to Understand Prognosis and Preferences for Outcomes and Risks of Treatment.

    JAMA 1995, 274:1591-1598. PubMed Abstract OpenURL

  81. Risser DT, Rice MM, Salisbury ML, Simon R, Jay GD, Berns SD, The MedTeams Research Consortium: The potential for improved teamwork to reduce medical errors in the emergency department.

    Ann Emerg Med 1999, 34:373-383. PubMed Abstract | Publisher Full Text OpenURL

  82. Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, Dukes KA, Berns SD: Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project.

    Health Serv Res 2002, 37:1553-1581. PubMed Abstract | Publisher Full Text OpenURL

  83. Pizzi L, Goldfarb NI, Nash DB: Crew resource management and its applications in medicine. [http://www.ahcpr.gov/clinic/ptsafety/chap44.htm] webcite

    In In Making Health Care Safer: a Critical Analysis of Patient Safety Practices. Evidence Report/Technology Assessment No 43. AHRQ Publication No 01-E058 Edited by Shojania KG, Duncan BW, McDonald KM. Rockville, MD: USA; 2001. OpenURL

  84. Intercollegiate Board for Training in Intensive Care Medicine [http://www.ibticm.org] webcite

  85. Krogstad U, Hoffos D, Hjortdahl P: Continuity of hospital care: beyond the question of personal contact.

    BMJ 2002, 324:36-38. PubMed Abstract | Publisher Full Text OpenURL

  86. Endacott R: Critical care: shifting boundaries and opening the doors.

    Intensive Crit Care Nurs 1999, 15:4-5. PubMed Abstract OpenURL