Category: Expert Witness Research

  • Reliability of Frequent Location History Data held to be Insufficiently Established

    Reliability of Frequent Location History Data held to be Insufficiently Established

    The Commonwealth alleged that at around 10:51 A.M. on March 31, 2015, the Defendant, a cooperating witness, and Jeromie Johnson participated in a home invasion on Harvard Street in the Dorchester section of Boston. Richard Long, Yvette O’Brien, and O’Brien’s newborn son were at home at the time of the attack. Johnson and the Defendant bound Long and O’Brien with electrical cords, cut Long with a knife, and shot both Long and O’Brien in the head. They then set fire to the house. Long died from his wounds. O’Brien survived the gunshot wound and could describe the events that occurred in the apartment until she was shot in the head, but she was unable to identify the perpetrators. The cooperating witness agreed to testify against the Defendant in exchange for facing reduced charges. The Commonwealth asserted that the cooperating witness would identify the perpetrators and their roles in the home invasion and associated crimes. The Defendant allegedly drove to the crime scene in a white sedan rented by his girlfriend for his use. The Defendant’s car was captured on video being driven down Blue Hill Avenue in Dorchester, with another car carrying Johnson and the cooperating witness following behind. The Defendant’s car was next seen parked on Paxton Street near the scene of the crime. At 10:44 A.M., the Defendant received a call from Johnson lasting over three minutes, and the Defendant called Johnson several times over the next few minutes with no answer. The Defendant’s telephone utilized a cell tower the coverage area of which included the crime scene for these calls. A video camera at a Department of Youth Services facility located across the street from the crime scene captured grainy video footage of two people approaching the victims’ home at 10:51 A.M., and the same video camera captured footage of three people leaving at 11:20 A.M. The Defendant’s car was captured on video at 11:22 A.M. being driven down Blue Hill Avenue.

    Prosecuting the Defendant for murder in the first degree and other crimes related to the home invasion, the Commonwealth moved in limine to permit the introduction at trial of frequent location history (FLH) data retrieved from the Defendant’s cell phone, an Apple iPhone 6.

    When turned on, an iPhone generated location data points from sources such as global positioning system (GPS) data, nearby wireless computer network (Wi-Fi) access points, short-range wireless Bluetooth connections, and cell site location information (CSLI). These location data points were stored on the iPhone’s “Encrypted B” cache for between twenty-four and forty-eight hours. In 2015, an algorithm on the iPhone would use these data points to create FLH data. The FLH data created by the algorithm consisted of a longitude and latitude coordinate point and a circle around it, representing an amalgamation of the location data points. The radius of the circle, labeled the “uncertainty” in the FLH data, represented the approximate area in which the cell phone was located. The uncertainty radius could change from visit to visit to a frequent location, as could the coordinate point representing the center of the frequent location. FLH data also provided an estimated time that the iPhone entered the location, and an estimated time the iPhone left the location. The algorithm used to convert location data points into FLH data was proprietary, and thus the Commonwealth’s expert did not have access to the algorithm itself during his testing of FLH data reliability. Moreover, it was unclear how the algorithm processed, or weighed, the different location data points generated by the iPhone.

    In 2022, a full-file system extraction was performed on the Defendant’s cell phone. This extraction allowed the Commonwealth to access encrypted files on the cell phone, including its FLH data. The FLH data on the cell phone listed 345 frequent location visits. Of particular interest to the Commonwealth was frequent location no. 58. Frequent location no. 58 was centered on coordinates corresponding to a Harvard Street address near the victims’ home. The uncertainty radius of frequent location no. 58 was forty-three meters, or 143 feet, which encompassed the crime scene. The Commonwealth’s proffered expert on FLH data, a senior crime analyst in the office of the district attorney for the Suffolk district (analyst), testified that he interpreted the FLH data retrieved from the Defendant’s cell phone to show that the phone entered the area represented in frequent location no. 58 at 10:36 A.M. on March 31, 2015, and left the area at 11:22 A.M. that day. The Commonwealth therefore contended that the proffered expert testimony on FLH data, if admitted, would corroborate the cooperating witness’s testimony placing the Defendant at the scene of the home invasion.

    On September 11, 2023, the trial judge denied the Commonwealth’s motion to permit the introduction of FLH evidence at trial. On the same day, the Commonwealth filed a notice of appeal, believing that the notice of appeal would stay the trial court proceedings pursuant to Mass. R. Crim. P. 15 (e), as appearing in 474 Mass. 1501 (2016). The Defendant filed a response, arguing that the Commonwealth’s notice of appeal did not automatically stay the trial court proceedings. Specifically, the Defendant argued that the appeal procedures in rule 15 were inapplicable, and that the Commonwealth’s only avenue for interlocutory review of the denial of a motion in limine was a petition under G. L. c. 211, § 3, which, in turn, did not automatically stay the trial court proceedings. The trial judge concluded that the Commonwealth’s appeal was outside the scope of rule 15, but nonetheless stayed the proceedings to allow the Commonwealth to pursue relief through a G. L. c. 211, § 3, petition. A single justice of this Court then extended the stay and subsequently reserved and reported the case to the full court, including both the procedural question of whether this appeal was within the scope of rule 15 and the merits of whether the trial judge abused his discretion in denying the Commonwealth’s motion to permit the introduction of FLH data.

    Discussion by the Court

    As a preliminary issue, the parties disagreed as to whether the Commonwealth may appeal from the denial of its motion to admit expert testimony under Mass. R. Crim. P. 15 (a) (2), as appearing in 474 Mass. 1501 (2016) (rule 15 [a] [2]), or whether its sole avenue for interlocutory review was a petition under G. L. c. 211, § 3.

    The text of rule 15 (a) (2) provided for interlocutory appeal from “an order determining a motion to suppress evidence prior to trial.” By its express terms, rule 15 (a) (2) “did not encompass other interlocutory rulings, in part for sound reasons of judicial economy, as such ‘rulings were subject to change when the case unfolds.” Although the text of rule 15 (a) (2) was directed only at motions to suppress, a narrow exception to this general rule was allowed: “if a motion to exclude all or most of the Commonwealth’s incriminating evidence is allowed, and if, as a practical matter, that ruling (if permitted to stand) would terminate the prosecution, the Commonwealth may seek leave to appeal pursuant to [rule 15 (a) (2)].”

    The Commonwealth suggested that rule 15(a)(2) should be interpreted more broadly to encompass other situations where “critical” evidence is excluded, even where the evidence excluded does not have the practical effect of terminating the criminal proceeding. The Commonwealth thus proposed that, although the exclusion of its expert’s testimony did not prevent it from introducing all or most of its incriminating evidence at trial, the instant appeal was properly brought under rule 15(a)(2) because the expert’s testimony regarding FLH data was “critical” to the case against the Defendant. Because its case at trial relied significantly on testimony by a cooperating witness procured in exchange for a reduced sentence, the Court agreed with the Commonwealth that evidence corroborating the cooperating witness’s testimony (and, thus, bolstering the credibility of that testimony) might fairly be described as “critical” to the prosecution’s case. Nonetheless, the Commonwealth’s invitation to expand the scope of rule 15(a)(2) to include the ruling on the motion in limine in the instant case was declined by the Court. The plain text of rule 15(a)(2) referred only to motions to suppress and thus set out the general rule.

    The Court determined that the Commonwealth’s avenue for interlocutory review of the ruling was a petition for extraordinary relief under G. L. c. 211, § 3, rather than an interlocutory appeal under rule 15 (a) (2).

    As for whether the trial court abused its discretion in holding the Commonwealth’s failure to establish the reliability of FLH data, the Court stated that when proposed expert testimony uses a new theory, or new methodology to apply an accepted theory, the proponent must establish its reliability using a Daubert-Lanigan analysis.

    When considering a motion to introduce expert testimony, a judge should initially consider five nonexclusive factors in determining the reliability of proposed scientific evidence:”whether the scientific theory or process (1) has been generally accepted in the relevant scientific community; (2) has been, or can be, subjected to testing; (3) has been subjected to peer review and publication; (4) has an unacceptably high known or potential rate of error; and (5) is governed by recognized standards.” Under the Daubert-Lanigan standard, “the judge, acting as gatekeeper, is responsible for making a preliminary assessment whether the theory or methodology underlying the proposed testimony is sufficiently reliable to reach the trier of fact.”

    As an initial matter, the Commonwealth contended that the trial judge erred in identifying the relevant field of expertise as cellular technology, rather than digital forensics. It claimed that this error evidenced a misunderstanding of FLH data and contributed to the trial judge’s erroneous conclusion that the analyst was not qualified to testify as an expert on FLH data. Contrary to these claims, it was declared on appeal that the trial judge correctly understood the analyst’s testimony on FLH data, and the relevant required expertise, and decided the pertinent issue: whether the Commonwealth had met its burden of establishing the reliability, under the Daubert-Lanigan standard, of FLH data.

    Regarding the first Daubert-Lanigan factor, general acceptance by the relevant scientific community, the trial judge found that the primary evidence in support of general acceptance was the analyst’s conclusory testimony to that effect, which, as the trial judge noted, was not well supported by the evidence in the record. The articles submitted in evidence by the Commonwealth in support of the analyst’s testimony largely discussed the technology that produced the location data points used as inputs by the FLH algorithm to output FLH data and instead of discussing the reliability of the FLH data themselves. The analyst identified two digital forensics experts whose writing he claimed supported his conclusion that FLH data had been deemed reliable by the scientific community, yet Commonwealth neglected to submit articles by these authors in evidence. Accordingly, it was noted on appeal that the trial judge did not abuse his discretion in concluding that the Commonwealth failed to meet its burden of showing by a preponderance of the evidence that FLH data had been generally accepted as reliable by the scientific community.

    When Commonwealth argued that because the FLH algorithm used as its inputs location data sources generally regarded as reliable (such as GPS, CSLI, and Wi-Fi location data), it meant that the FLH data output by the algorithm consequently was also generally regarded as reliable. The Court, however, held that even if the inputs used by the FLH algorithm were generally deemed reliable, the FLH data outputs were not ipso facto reliable, especially given the lack of scientific literature or adequate testing to support reliability.

    As for the second Daubert-Lanigan factor, whether the technology can be or has been tested, it was held that the trial judge did not abuse his discretion in holding that there was not sufficient testing to establish the reliability of FLH data. The trial judge found that the analyst’s experiments with FLH data had a small sample size. The analyst conducted tests of FLH data reliability using a “jailbroken”iPhone (test iPhone) that was similar, but not identical, to the iPhone associated with the Defendant. In other words, to test the reliability of FLH data, the analyst jailbroke an iPhone 5C, which allowed him access to information that is ordinarily encrypted and inaccessible to an iPhone user. He brought the jailbroken iPhone to five different locations, examined the underlying location data points gathered by the iPhone at those locations from sources such as CSLI, Wi-Fi, and GPS, and compared these underlying location data points to the FLH data outputs produced on those locations. The analyst visited each of the five locations two or three times, for a total of twelve  experiments. Despite his testing, the analyst did not know the algorithm used in creating FLH data and did not know how various factors were weighed to create FLH data outputs. The analyst also could not explain how the uncertainty radius for a frequent location was determined. He was able to identify that the uncertainty radius and center coordinate point for a frequent location could change with each visit to that location, but he was unable to explain why the uncertainty radius for a frequent location changed or whether data from previous visits contributed to how FLH data changed after a subsequent visit to the location. Moreover, while the FLH data for some locations included a “confidence level,” the analyst could not explain what the confidence level meant, why some locations had a confidence level and others did not, or how the confidence level was calculated.

    The Commonwealth also argued that the trial judge abused his discretion by failing to make findings regarding evidence that certain frequent location visits identified on the Defendant’s cell phone were corroborated by other data on the phone. The Commonwealth asserted that the data corroborating the frequent location data bolstered the analyst’s testing as evidence that FLH data are reliable. For example, the analyst testified that frequent location no. 73 on the Defendant’s cell phone corresponded to a location at a mall in Newton. The FLH data suggested that the cell phone was at frequent location no. 73 from 7:26 P.M. to 7:32 P.M. on March 29, 2015, two days before the murder. The uncertainty radius for frequent location no. 73 was ninety-one meters, meaning the FLH data represented that the cell phone was likely within a ninety-one meter radius of the determined center point for location no. 73. Two images recovered from the Defendant’s cell phone were taken at 7:31 P.M. and 7:32 P.M. on March 29, and appeared to have been taken in the northwest corner of the mall parking garage. The Commonwealth suggested that the pictures corroborated the reliability of frequent location no. 73 because they placed the Defendant near the location during the relevant time. The analyst testified regarding four other frequent locations extracted from the Defendant’s cell phone that were corroborated either by pictures taken on the phone indicating it was in the area of the frequent location during the relevant time period, or by data showing the phone connected to Wi-Fi networks associated with a location while the FLH data indicated the phone was at the location.

    It was held on appeal that even if evidence of the five corroborated locations were considered alongside the twelve experiments conducted by the analyst, it was well within the trial judge’s discretion to hold that the Commonwealth had not met its burden of showing that FLH data had been sufficiently tested to show its reliability. To sum it up, judges were not required to make explicit findings on all the evidence presented at a hearing.

    As for whether the trial judge abused his discretion in his discussion of the other Daubert-Lanigan factors of whether FLH data evidence (3) had been subjected to peer review and publication; (4) had an unacceptably high known or potential rate of error; and (5) was governed by recognized standards, it was observed that the testing of FLH data performed by the analyst was neither peer-reviewed nor published. In terms of other publications, the trial judge found that the articles and materials submitted by  the Commonwealth discussing the underlying technology (GPS, Wi-Fi, and CSLI) were not “particularly instructive.” He also noted that there were “very few references to FLH in any of the papers submitted into evidence.”

    The trial judge held that the fifth prong of Daubert-Lanigan, recognized standards, was satisfied by the existence and admission in evidence of Federal regulations setting standards for analyzing cell phone location information generally. The Commonwealth argued on appeal that because Federal regulations existed for cell phone location information and were in effect at the time of the murder, the fourth prong, known or potential rate of error was sufficiently met. The Commonwealth did not otherwise provide any evidence or argument as to why the trial judge erred in holding that it had failed to meet its burden on the fourth prong. No abuse of discretion was observed by the trial judge on appeal when it was held that the fourth prong had not been met, particularly because of the various characteristics of FLH data that the analyst could not explain, including the uncertainty radius and confidence level.

    Held

    Because the challenged evidentiary ruling involved neither the determination of a motion to suppress nor the pretrial exclusion pursuant to a motion in limine of evidence that, as a practical matter, would terminate the Commonwealth’s prosecution of the Defendant, it was held on appeal that the Commonwealth’s avenue for interlocutory review of the ruling was a petition for extraordinary relief under G. L. c. 211, § 3, rather than an interlocutory appeal under Rule 15 (a) (2). Moreover, having considered the merits of the Commonwealth’s petition, it was concluded that the trial judge did not abuse his discretion in denying the Commonwealth’s motion in limine to admit the  proffered expert testimony regarding the FLH data. Accordingly, the case was remanded to the county court for entry of a judgment affirming the trial court judge’s order and remanding the matter to the trial court for further proceedings consistent with this opinion.

    Key Takeaways:

    The trial judge found that the Commonwealth did not adequately demonstrate the general acceptance of FLH (frequent location history) data as reliable by the scientific community. Despite arguments from the Commonwealth, including testimony from an analyst, the evidence presented was deemed insufficient to establish widespread acceptance of FLH data’s reliability. Additionally, the Court held that there was not enough testing to establish the reliability of FLH data outputs. The analyst’s experiments were criticized for their small sample size and lack of understanding of the algorithm used to generate FLH data. The Commonwealth also argued that certain frequent location visits identified on the Defendant’s cell phone were corroborated by other data, such as pictures taken on the phone or data showing the phone connecting to Wi-Fi networks associated with a location. However, the Court determined that this evidence, when considered alongside the analyst’s experiments, did not sufficiently demonstrate the reliability of FLH data. The Court assessed the case against the Daubert-Lanigan factors, including peer review, potential rate of error, and recognized standards. Lack of peer review and publication, as well as unanswered questions regarding the reliability of FLH data, contributed to the court’s decision. While Federal regulations existed for analyzing cell phone location information, the Court held that the Commonwealth failed to meet its burden in demonstrating that FLH data met recognized standards. Overall, this case underscores the importance of rigorous testing, peer review, and adherence to recognized standards in establishing the reliability of expert testimony, particularly in cases involving complex technological evidence.

    Case Details:

    Case Caption: Commonwealth v. Arrington
    Docket Number: SJC-13499
    Court: Massachusetts Supreme Judicial Court
    Citation: SJC-13499 (Mass. Feb. 20, 2024)
    Order Date: Feb 20, 2024
  • South Dakota Supreme Court affirms exclusion of polygraph evidence in the absence of agreement between the parties 

    South Dakota Supreme Court affirms exclusion of polygraph evidence in the absence of agreement between the parties 

    A polygraph examination is conducted by an expert polygraph examiner to make a polygraph evidence

    Background 

    The case examines the admission of polygraph evidence in criminal and civil cases. Banks pled guilty to first-degree manslaughter and prior to his sentencing hearing sought to introduce polygraph analysis as evidence to prove that he was not the shooter. The Circuit Court decided to preclude the polygraph examination from the evidence, which subsequently led to Bank’s appeal, where he pursued the issue of whether the Circuit Court erred in excluding the polygraph evidence in its sentencing consideration. This case basically examines the Court’s stance in examining the use of and admission of polygraph evidence. 

    Facts 

    On 26th February 2020, Casey Bonhorst succumbed to his death from a gunshot wound, when he was out delivering a pizza to a home in Sioux Falls. Raymond Banks and Jahennessy Bryant were charged as co-defendants on August 12, 2020, in a five-count superseding indictment that included two counts of first-degree murder, one count of second-degree murder, one count of first-degree manslaughter, and one count of attempted first-degree robbery based on the subsequent investigation by the law enforcement. 

    Both Raymond Banks and Jahennessy Bryant stuck to varied accounts of the events leading to Bonhorst’s death throughout the proceedings. Byrant claimed that he was on the lookout and Banks was the shooter, whereas Banks made opposite claims in his version of events. During the change of plea hearing of Banks, the State demonstrated its support for Bryant’s version of events while describing the factual basis for the plea and held Banks to be the shooter. The factual basis for the plea provided by the Court was initially contested by Banks, but he eventually agreed to aiding and abetting the situation after the Court interrogated him.

    Banks’s guilty plea was accepted by the Circuit Court before sentencing Banks to eighty years in prison, with twenty years suspended. When Banks urged the Circuit Court to admit the results of the polygraph examination, the Circuit Court refused, and the Appellate Court upheld the Circuit Court’s refusal. 

    Discussion by the court 

    Banks appealed against the ruling of the Circuit Court regarding the admission of polygraph evidence. The Appellate Court held that Banks failed to demonstrate error on the Circuit Court’s part when it precluded the results from the polygraph examination as evidence. Before going through with the sentencing hearing, Banks established the results of a polygraph examination as evidence from an examiner named Mike Webb (W. Michael Webb). Webb was a trained and licensed polygraph examiner with over 25 years of investigation and interview experience.  

    The polygraph result showed that there was “no significant reaction that indicates deception” when he answered “no” to questions regarding whether he had shot Bonhorst on the date in question. However, the State was opposed to admitting any testimony regarding the polygraph examination as evidence, stating that polygraph examination results cannot be admitted in the absence of an agreement between both parties, citing State of South Dakota V. Janice Stevenson

    The Circuit Court upheld the State’s argument because of reliability concerns which were exacerbated in the absence of an agreement between both parties and because the polygraph here was commissioned by Banks alone and the State did not find out about it until after it had been administered. The Circuit Court cited significant state and federal Appellate Court decisions which refused to weigh in polygraph evidence because of reliability concerns associated with the accuracy of polygraph examinations. Moreover, Banks has failed to show how the Circuit Court’s ruling would be “clearly against reason and evidence,” or “outside the range of permissible choices.” Based on these grounds that the Appellate Court affirmed the decision of the Circuit Court. 

    Held 

    The Appellate Court affirmed the Circuit Court’s ruling. It was held that the Circuit Court did not abuse its discretion by excluding the polygraph examination.  

    Key Takeaways 

    This case debated the grounds for the Court to preclude the admission of the results of a polygraph examination.  

    Banks was tried for and subsequently pleaded guilty to first-degree manslaughter. Prior to his sentencing hearing, Banks insisted on admitting the results of a polygraph examination as evidence from an examiner named W. Michael Webb regarding his role in the crime. Despite the Court admitting to having relied on police reports, prior testimony, forensic evidence reports, and the additional information contained in the presentence investigation reports due to the lack factual clarity regarding the events of the case, the Court noted the absence of an agreement or stipulation between the parties as to the use of polygraph evidence to be a part of its admissibility criteria.

    Moreover, considering the polygraph here was commissioned by Banks alone and the State did not find out about it until after it had been administered, the Court cited precedent setting cases to state that polygraph evidence have not been admitted by the Courts especially if the reliability is called into question before precluding the results of the polygraph examination.

    The Court sentenced Banks to eighty years in the penitentiary with twenty years suspended and the Appellate court held that the Circuit Court did not commit an error by precluding the admission of the results of the polygraph examination before affirming the Circuit Court’s sentence.

    Despite W. Michael Webb’s investigation and interview experience of over 25 years, had there been an agreement or stipulation between the parties as to the use of polygraph evidence, the Court would have been likelier to consider the results of the polygraph examination and if it confirmed anything substantial about Banks’ version of events, he might have been awarded a reduced sentence. 

    Case State v. Banks
    Court Supreme Court of South Dakota
    Judgment Date July 26, 2023
  • Expert Witness Research Survey:: 2017-18

    Expert Witness Research Methods and Data Sources

    Whether you are an attorney, paralegal, law librarian or legal researcher, any legal professional who works in the expert search and research arena must surely notice that the space is highly fluid, dynamic and evolving at a near dizzying pace.

    Almost weekly, a new product, service, company emerges and each touts the latest and greatest approach for solving the expert location and research conundrum. It’s really no surprise. The old adage, “litigation in the United States is a battle of experts” is arguably still largely true. Interestingly, however, expert witness research and retention techniques continue to be highly variable and fragmented and even vary widely among legal professionals in the same firm.

    With these phenomena as a backdrop, we decided that a comprehensive survey would be of great utility to better understand how legal professionals actually now identify and research experts.

    The survey was completed by 580 legal professionals with varying roles in their firms and representing firms of varying sizes and orientation. The survey respondents have one thing in common: all are deeply involved in the day in and day out practice of litigation.

    Index

    1. Demographics of Survey Respondents
    2. When looking for an expert with specific expertise, what do you do?
    3. Have you ever used any of the following Expert Witness Referral firms?
    4. Do you plan to use any of the following expert witness referral firms during the next 12 months?
    5. Have you ever used any of the following Expert Witness directories?
    6. When researching experts, how important are the following sources/research items?
    7. Which outside sources have you used to locate information about an expert witness previously?
    8. What issues present the most difficulty for effective expert witness research?
    9. At the conslusion of a case, what happens to collected information regarding a hired, opposed or researched expert?
    10. Have you ever been in a work situation where you were unprepared/surprised by something about an expert’s background or experience?
    11. Has lack of sufficient knowledge/research about an expert involved in a case ever materially impacted a case outcome for a case in which you were personally involved?
    12. About the Authors

    Demographics of Survey Respondents

    A total of 580 people responded to the survey. Of those, 65.3% personally conduct research on expert witnesses and 20.0% supervise research conducted by others. 11.4% of the respondents request others to perform research for them. The majority (81.5%) of the respondents are attorneys. The remainder list themselves as librarians/information professionals, claims or knowledge management professionals.

    Many respondents (48.6%) are from small firms (2-49 attorneys) and 18.0% are from medium firms (50-199 attorneys). Members of large firms (200+ attorneys) make up 16.9% of the respondents. The remaining respondents are solo practitioners or work for corporate law departments or insurance companies.

    Survey respondents are primarily based in the United States. Respondents reside in the South (31.4%), the Midwest (27.0%), the Northeast (20.0%) and the West (19.8%). There were 7 international professionals that completed the survey.

    [↑] Top

    When looking for an expert with specific expertise, what do you do?

    Performing a Google search is the most common approach used to locate an expert with specific expertise. Other top methods include sending inquiries to colleagues either inside or outside the firm, as well as searching internal databases. The majority of respondents prefer to perform search themselves, as opposed to using an outside search firm. Other write-in answers include searching Amazon for authors of books on the needed expert subject matter, seeking referrals from other experts and researching trial transcripts.

    [↑] Top

    Have you ever used any of the following Expert Witness Referral firms?

    Have you ever used any of the following Expert Witness Referral firms?

    Over half of the respondents to this question (50.1 %) have never used an Expert Witness Referral firm to acquire an expert witness. Of those that have used such a service, 28.1% have used TASA for their referrals. The Round Table Group (Thomson Reuters Expert Witness Services) is the only other firm to have been used by more than 10% of the respondents.

    One response typifies an overall sentiment expressed by many respondents: “I use such outfits only if I cannot come up with a local/regional expert from my own experience or referral from other counsel. Word of mouth (is) a much more reliable source.” Other respondents indicate that they have located experts by turning to an independent firm that employs a team of experts, such as Robson, Charles River Associates and others.

    [↑] Top

    Do you plan to use any of the following expert witness referral firms during the next 12 months?

    Do you plan to use any of the following expert witness referral firms during the next 12 months?

    Consistent with the last question, 71.4% of respondents do not plan to use any expert witness search service provider during the next 12 months. The three most mentioned providers for those respondents planning to use one were TASA, the Expert Institute and Round Table Group (Thomson Reuters Expert Witness Services).

    One respondent noted concerns about using experts obtained via an expert witness referral firm—”I have always had a hard time using referral firms on the defense side particularly. After one jury trial where the plaintiff used a service, and we brought that out on cross, one of the jurors commented that ‘once we heard they got their expert from Experts R Us, they lost a lot of credibility.’ So, until there is some sort of a work around where the service perhaps finds the expert, but is not directly involved, I will have a difficult time getting too enthusiastic.”

    [↑] Top

    Have you ever used any of the following Expert Witness directories?

    Have you ever used any of the following Expert Witness directories?

    42.1% of respondents have never used an expert witness directory. Of those that have, nearly one-third prefer to use a state or local bar association listing. Only three of the listed firms: ALM Experts, SEAK and JurisPro were used by more than 10% of those taking the survey. The most popular “Other” mentions include the DRI list server and state defense bar association database.

    [↑] Top

    When researching experts, how important are the following sources / research items?

     

    When researching experts how important are the following sources/research items?

    There are many important evaluation criteria outlined by expert witness researchers. Verifying licenses and credentials is the top priority, followed closely by confirming details found on curriculum vitae. Authenticating degrees and education ranked third in importance, followed by vetting of Daubert or similar challenge outcomes, when available. Recommendations, reviews and testimonials from other attorneys who have direct experience working with the expert are the next most valuable piece of information followed closely by testimony transcripts.

    [↑] Top

    Which outside sources have you used to locate information about an expert witness previously?

    Which outside sources have you used to locate information about an expert witness previously?

    When searching for information on expert witnesses, the majority of those taking the survey turned to DRI (60.3%) and Westlaw (59.9%) to research experts. Lexis Advance was the third most popular resource with 31.8% of respondents using its service. Bloomberg was used by 17.3% of respondents and Daubert Tracker data was relied upon by 12.8% of respondents. Expert Witness Profiler, Lexis Profiler Suite and Fastcase were all used by approximately 10% of those taking the survey. Those that indicated they used “Other” sources mainly utilized a state or regional defense association database.

    [↑] Top

    What issues present the most difficulty for effective expert witness research?

    What issues present the most difficulty for effective expert witness research?

    Issues that present the most difficulty during effective expert witness research are unreliable or incomplete information and a lack of sufficient research tools. One popular mention includes difficulty in assessing an expert’s level of experience in testifying. Time pressures to complete the research and client’s unwillingness to pay for expert witness research are the next two biggest roadblocks facing respondents. Challenges to effective research can be summed up by one respondent who stated “there is no best place to go for all experts.”

    [↑] Top

    At the conslusion of a case, what happens to collected information regarding a hired, opposed or researched expert?

    At the conslusion of a case what happens to collected information regarding a hired opposed or researched expert?

    At the conclusion of a case, the majority of respondents file all expert witness information away, along with the case file. The problem with this approach is that, often, no one else knows which experts have been researched, which files contain the information and the extent of the research. In many cases, research may end up being repeated for subsequent matters. In others, attorneys may not be aware that an expert has already been retained or vetted. Other respondents collect their expert witness research information in an internal electronic database, thereby making it available to others in the future.

    [↑] Top

    Have you ever been in a work situation where you were unprepared / surprised by something about an expert’s background or experience?

    Have you ever been in a work situation where you were unprepared/surprised by something about an expert background or experience?

    Almost 60% of respondents have been surprised by at least one aspect of an expert’s background or expertise. 32.5% of those taking the survey have been surprised by prior opinions and 18.5% have been surprised by the expert’s challenge history or exclusions. Attorneys also have been surprised during trial with discrepancies involving other seemingly straightforward, easy to obtain information such as an expert’s work history and education.

    Further, several respondents reported being surprised by an expert’s criminal history, lawsuits involving the expert, malpractice suits, plagiarism and falsified curricula vitae. These findings reiterate the critical importance of thoroughly vetting an expert witness.

    [↑] Top

    Has lack of sufficient knowledge / research about an expert involved in a case ever materially impacted a case outcome for a case in which you were personally involved?

    Has lack of sufficient knowledge research about an expert involved in a case ever materially impacted a case outcome for a case in which you were personally involved?

    Fortunately, only 10.4% of respondents report being involved in cases that were directly impacted by insufficient knowledge about expert witnesses. The two most commonly reported situations involve prior testimony containing conflicting opinions and misstated licenses or credentials. Specific examples include the following:

    • An expert’s credentials had been restricted between the time he was retained/deposed and the date of trial.
    • An unlicensed expert who claimed his license was valid was impeached.
    • An expert misled counsel about his experience as an expert witness and completely folded during his deposition.
    • An expert published several articles that contained opinions which contradicted his opinion in the case.
    • An expert let his engineering license lapse prior to testifying at trial.
    • Opposing counsel had not vetted its expert and was unaware of several troubling Daubert challenges and testimony exclusions.
    • A purported nurse providing medical bill review was not licensed.
    • A highly regarded and recommended expert did not testify well before the jury, although he performed fine during his deposition.

    [↑] Top

    About the Authors

    Mark Torchiana is co-founder and CEO of Courtroom Insight, which offers an expert witness knowledge management solution to law firms and legal organizations. The platform provides a systematic, organized approach to managing an organization’s knowledge about expert witnesses. In addition to founding Courtroom Insight, he has over 20 years of experience providing forensic accounting litigation support and expert witness services.

    Myles Levin is founder and CEO of the Daubert Tracker and Principal of Expert Witness Profiler. Since it’s launch in 2002, Daubert Tracker’s collection of “evidentiary gatekeeping” cases has received significant attention in the legal community. Expert Witness Profiler offers custom research services using advanced tools and techniques to locate difficult to find information about expert witnesses. He is a former testifying vocational expert and principal in a litigation consulting company.

    Article Reproduced from: https://www.courtroominsight.com/expert-witness-research-survey

    [↑] Top