Thursday, November 24, 2016

Authorship customs and citation counts




I promised some blog posts on some of the many distinguished women who have made classic contributions in psychiatric epidemiology, and I decided to start by reviewing work of several whose work I read when I was a postdoc, but never had the pleasure of a familiar acquaintance or a personal contact of any lasting duration.

For other reasons, Rema Lapouse came to the top of my queue this month, and I discovered a very clearly articulated description of some problems to be solved in psychiatric epidemiology, written by her in 1957, roughly 10 years after her studies at Johns Hopkins School of Hygiene and Public Health.

Lapouse, AJPH, 1957.

She died too young, in 1971, and I never met her, but her papers were recommended to me by Mort Kramer and Ernie Gruenberg when they were introducing me to this field.

I did meet Barbara Snell Dohrenwend in the late 1970s, and I believe it was when the American Psychopathological Association still was meeting in a small low ceiling mini-hall in the lower floors, possibly the basement of the old St. Moritz Hotel opposite the Pond in NYC Central Park. But this was no more than a passing acquaintance, and she died too young as well, in 1982.

To start with the end, here is BSN's obituary in the NYT:

BSN obituary


Here is a link to her collected archives at Columbia University: archives

I wanted to re-read her books with Bruce Dohrenwend so I started to track them down. The search led me to this article by Bruce, which provoked me to write a note about changing authorship customs, and the impact on science citation counts, etc.

Take a look below to see a 1970 handling of collaborators in a major field survey of the time, all of whom apparently did heavy lifting to produce the evidence reported here, but whose names do not appear in the authorship list. Instead, they appear in the acknowledgments. As such, their names would not be attached to the citation count for this article.

Contrast the modern custom of including the name of an author who has proofread the paper and done little else, or consulted on a statistical approach, or some minor assist of that type, but did not read the manuscript before it was submitted for publication.

I leave you to judge whether the modern custom is an improvement, but when I see colleagues on authorship lists for more than about 12 published papers per year, 1 per month, I always wonder whether there has been a full reading and thorough critique of each manuscript before (or after) submission, or whether there is some kind of courtesy authorship custom in motion. (Or whether they have no administrative and instructional or mentoring duties. Mentoring of new faculty members, especially, requires a senior author to help others to get their work polished up for publication, but deserves nothing more than the type of acknowledgment that Professor Dohrenwend models for us in his acknowledgements section. Even when an authorship position might be contemplated on the basis of many red pencil marks on the manuscript page, or even when help has been conveyed during the design or conduct phases of the work, the inclusion of the mentor in the authorship list can actually harm the early career colleague's reputation as an independently creative scientist. Mentors should be allowed to bask in reflected glory on many occasions, with the spotlight shining directly on the future of the field, and sometimes one should write solo author papers, even when many others contributed to the effort, with gracious acknowledgments as exemplified below, written by still-active Bruce Dohrenwend when he was some 46 years younger than he is now.)

Bruce Dohrenwend 1970















Tuesday, November 22, 2016

What is a 'Symptom'?




So, when we look at the natural history of drug involvement, what are we to make of a cannabis user who says "I have to take more of the drug to get the same effect." Presumably, if the user is getting the drug from an official MM vendor, dosage is more or less held constant. Or is it? And if the user is getting it on the street, the dosage is even more unknown. So, is that report a substantiation of a 'symptom' of a drug dependence process? To hard to tell.

For this reason, we use the term 'clinical feature' when we are uncertain about whether the user report is a symptom or whether it's something else (an 'experience'?).

Tolerance is a clinical feature of the neuroadaptational facet of drug dependence, and we ask about tolerance in our assessments of drug dependence, but the answer to that single question doesn't make it into a 'symptom' or 'symptom report'. It is a report on a drug experience, that in context we think of as a hypothesized clinical feature of what might be an underlying syndrome.

But suppose the user reports this 'tolerance experience' but nothing else remarkable is going on? Then is it a symptom? For sure not ! But is it still a 'clinical feature' for drug dependence. Yes, it is, but not 'of drug dependence as observed in that user'.

We have some papers on the profile of symptoms observed in users who qualify for the drug dependence syndrome case definition. In that context, when the user clearly qualifies as a case of drug dependence, we are well within standard psychopathology scientific practice to say that we are studying the profile of symptoms in a set of users found to qualify as cases of the drug dependence syndrome.

But when we are studying emergence of clinical features, one by one, in a set of newly incident users, irrespective of whether they have become cases of drug dependence, then we are not studying the symptoms of drug dependence in those patients. Hence, we shift to the term 'clinical features'.

Many years ago, we used the vocabulary terms 'experiences' and 'problem experiences' and even 'problems' in order to avoid what then was called 'over-medicalization' of illness experience. (See Austrian philosopher Ivan Illich.) About the time of the NIMH ECA studies, we were allowed to speak of symptoms and clinical features even when talking about drug experiences.

[What's the problem with 'problem'? Well, consider when you ask an LSD user whether the drug has caused them to have hallucinations or illusions, and they enthusiastically say they have had that happen, and then you ask "Was that a problem for you?" The response often is a puzzling look, shift of eyebrows, etc. (That's why they were taking the LSD in the first place. It wasn't a problem for them. It was what they were seeking in the LSD experience.) Not a problem. Just an experience.]

Until the pendulum swings again, I urge you to think carefully about whether you are studying 'symptoms' as can be seen in suspected or confirmed cases, but more of the time, you can save yourself trouble with reviewers by speaking of these experiences as 'clinical features' of the syndrome or as 'clinical features associated with' the syndrome. That is, the object of study is anchored as something that is found in the context of a syndrome and helps to define the syndrome via its 'running together' with other clinical features. And then the methods of study, if limited, become interpretable as a mixture of signal and noise, where the signal would be an experience that truly is a 'symptom' of an underlying pathological process.

But for the most part, reviewers tend to go along with 'clinical features' (and many would accept, without thinking, the use of the term 'symptom' if they never have studied psychopathology seriously). But you can be disciplined about your use of the term 'symptom' and show that you are a serious student of psychopathology.

Unless our trainees are studying known cases for whom the pathological process is well-characterized, I ask them to use the term 'clinical feature' or 'experience' in lieu of 'symptom' and that seems to satisfy even the most serious students of psychopathology one encounters in the peer review community. 

Even once in a while, a reviewer will insist on use of the term 'symptom' and I find that a note to the editor of the journal is sufficient to address that kind of reviewer misbehavior. [Proper reviewing behavior would be to raise a minor word choice issue and suggest an alternative, but not to insist on one's preferred word choice as a condition of accepting a manuscript for publication. But proper reviewing behavior is another topic. I won't post a blog on that topic unless the reading audience files comments to ask for it. I'm enough of a pontificator as it is, but you'll have to encourage me to pontificate on that subject, which is not really about neuropsychiatric epidemiology.]

Monday, November 21, 2016

About the experience of taking a medicine



Medication = the process of administering, including self-administration.

Medicine = what is administered

Medicine NOT the same as medication.

For a great museum display on what people say after they have been medicated or have engaged in self-medication:


Medication-Artifact Museum

RDoC and your future (if NIMH funding is something you seek)

RDoC Resources, including webinars

Sunday, November 20, 2016

FEAD: Film Exchange on Alcohol and Drugs and a question for Blog correspondents

FEAD: Film Exchange on Alcohol and Drugs


I found this web resource when looking up whether Virginia Berridge's also might be from South Africa. (No autobiography or biographical details on Professor Berridge's found yet.)

Is there any similar audiovisual web resource for neuropsychiatric epidemiology?

Also, heavily UK oriented?

Should CPDD do something more international?

ACNP has a useful video archive as well as transcripts from our history project.

[It was now-deceased Vanderbilt Professor of Pharmacology Oakley S. Ray, with whom I had corresponded since 1972, who hooked me into the ACNP History Committee, and I came up through its ranks to become the chair of that committee about the time ACNP was celebrating its 50th anniversary. As events would unfold, in a cost-cutting move and perhaps in fallout from our invitations to have Cathy DeAngelis and David Healey give committee-sponsored lectures that were deemed controversial by some members, ACNP Council de-commissioned the History Committee about that time. Perhaps I'll go down in ACNP history  as the last chair. (Putting it that way, I guess I'm a captain who did not go down with the ship.)]

C. DeAngelis Web Site after she returned to Hopkins from JAMA.

Catherine DeAngelis ACNP lecture (History of Women in ACNP)

David Healy ACNP lecture

Women in psychiatric epidemiology

As I look over my prior posts, I see almost exclusive coverage of work by men, generally white of European descent.

I shall try to add some diversity now and in the future. If I understand correctly, Joy Mott helps in two ways, including her South Africa heritage.

Perhaps blog-correspondents can suggest others I might neglect otherwise

Recent re-reading is from and about Joy Mott, Rema Lapouse, and Mary Monk, and a new find is Virginia Berridge at the London School:

Joy Mott

Rema Lapouse and Mary Monk, et al.

Virginia Berridge: Start here.

More of V. Berridge's work in this field.

Interviews with V. Berridge

Youtube contributions from a link on V. Berridge's web site:
https://m.youtube.com/watch?v=bLhHcoVq1Ew

More planned to follow on  Ruth Fairbanks, Lee Robins, Barbara Dohrenwend, Jane Murphy, Charlotte Silverman, Anita Bahn, Zena Stein (who panned our first NIMH R01 proposal during a site visit to Hopkins with Eugene B. Brody of UMaryland, in what probably was a lifelong favor to me), Myrna Weissman, Glorisa Canino, Judy Brooks, and Linda Cottler, to mention just a few who deserve mention.

On tools in psychiatric epidemiology (and the value of long distance networking)

Study the most influential contributors in your chosen field: Tools you can use

Available via MSU and other e-resources, if not direct from Wiley Online.

You can interview those who are most expert in your own specialization area.

I was lucky to be paid by DEA to travel around the US and to interview many luminaries in preparation for my dissertation research.

Often, in those days (early 1970s), it just required writing in advance and getting reply to request (all snail mail until Group 2 telefax machines made fax fast and cheap in late 1970s), and then flying to a meeting, either a scientific or professional meeting where the expert was willing to meet, or to the office. The interviews fed directly into the conceptual model I had to build, but also gave me valuable career advice.

(DEA was generous. I flew all over the place and made wonderful contacts with field leaders, some of whom ended up writing letters of recommendation for my promotion and tenure at Hopkins, for my election to scientific organizations, etc. -- because they knew me since I was 23-25 years old, and could see what I was doing over the years.)

[In 1972-75, each page of a fax took as many as 7-8 minutes to send, over a standard telephone line. In 1972, when I was writing the research proposal to DEA, most offices did not have a fax machine; it all was snail mail for this type of correspondence unless you got someone who would take a blind call on the long distance phone (still pretty much a telephone monopoly and priced accordingly).]

You can't believe how happy we were when the Group 2 fax standard came out in ~1978 and most offices could afford a fax machine and to pay for the outgoing call, but within about five years (1982-83) ARPA BITNET came online for academia, and made it possible for me to forge a trans-Pacific proposal for Alzheimer's disease research in Australia, where Scott Henderson and Tony Brie were based. Then, eventually, by 1985, they had cobbled together funds from the Australian MRC and our Fulbright Commission so I could fly the family to Sydney-Canberra for three months in 1986 to finalize design and conduct of the first community-based case-control study of Alzheimer's type dementia. In the process, I was able to convert my early use of the Mini-Mental State Examination for ECA sampling of community dementia cases, and put it to work in a general practice surveillance for dementia among seniors living in a Sydneyside catchment area. In this work, we picked up a signal of potential protection from OTC analgesic and anti-inflammatory drug compounds like aspirin, as we had hoped to see based on prior pre-clinical studies:

https://www.ncbi.nlm.nih.gov/pubmed/1615110

Concurrent with set-up and completion of that work in Australia, John Breitner and I had been trying (unsuccessfully) to get funds for epidemiological research on AD in the US, and with Marshal Folstein's help, I had been working out details for putting the McHugh-Folstein Mini-Mental to work as a first stage large sample assessment tool in a sequenced multi-stage sampling (SMSS) for probability gradient sampling of cases and non-cases for intensive diagnostic workup, and assessments of suspected causal influences. Perhaps coincidentally, the NIMH ECA leadership decided they needed a standardized assessment of cognitive functioning for the five-site epidemiological catchment area surveys; they chose the Mini-Mental, allowing us to take the community design John and I had written into our first (unsuccessful) NIMH R01 proposal, and put it into play with an NINCDS supplement to the NIMH ECA collaborative agreement. The SMSS design can be seen in #1 in pilot form for general medical ward research, and in #2 in community survey form:

Mini-Mental MMSE Epidemiology Early Days

While in Australia with Scott and Tony, I continued working with John Breitner on his insights into the use of co-twin studies of our hypothesized protective associations, but that's another story that unfolded into the era that included widespread global communication and resource-sharing via the post-BITNET internet tools for our research collaborations:

Some neuropsychiatric epidemiology history on using aspirin and other anti-inflammatories to prptect against Alzheimer's type dementias

Methods and tools pay a central role in the discovery processes of psychiatric epidemiology.

* See Holst Norwegian surveys of 1825-35, Rosanoff Nassau County survey from 1916-17, Gruenberg survey of civil commitment-eligible community elders, and Lemkau-Stampar survey of schizophrenia in NE Yugoslavia for where I got the idea to harness MMSE in large sample epidemiological studies of the dementias, with second stage diagnostic workup. Scott Henderson's panel survey of stressors and psychiatric morbidity in the mid-1970s provided key references to the quality control work of Eugene Deming, and I think Scott said he worked those out with the help of Paul Duncan-Jones, a great thinker who died too young. I covered Holst, etc., in prior blog posts. I'll try to add on on the Henderson panel survey before too long.

p.s. Let me know if these embedded links are not working. I set them up, possibly incorrectly.

Monday, November 14, 2016

NSDUH R-DAS resurrected as less useful somewhat clunkier PDAS



Details here, but do some exploration:

http://pdas.samhsa.gov/#/?_k=6dmm20

I can see no STATE nor REC nor ELG nor other useful constructed variables that formerly were in R-DAS (e.g., ungrouped age in years).

It looks as if PDAS draws on the same dataset as one would use for online SDA analyses, based on a couple of checking runs I did.

For example, here is the unweighted count and weighted count for age and sex of adults in SDA for 2013 and in PDAS for 2013. I am not seeing much difference.
SDA:
https://drive.google.com/open?id=0B9Ud1oy4LsimeVNsZE5leEdIUXM
PDAS:
https://drive.google.com/open?id=0B9Ud1oy4LsimRC1wOFoxU3VGVG8



Here is pair of SDA and PDAS runs on crack flag and cocfyu, also with minor variations that suggest use of same datafile.
SDA:
https://drive.google.com/open?id=0B9Ud1oy4LsimS0Z5U1ZwNXNTYm8

PDAS:
https://drive.google.com/open?id=0B9Ud1oy4LsimeUp0cWVMZGdWTkk

It would appear that PDAS functionality has been reduced in the shift of the subcontract from ICPSR to RTI, sadly.

I tried and was able to achieve a "Network Request Failed" error message as shown here in an attempt to get an age-specific estimate of the probability of starting to drink in 2011 and continuing to drink in the month prior to assessment in 2013. (Always pays to push the system to its limits, sooner rather than later.) I am not sure whether there is a "confidentiality" rule at play, or something akin to a CPU limit being set. Someone should push it and then ask the help desk with a concrete example.

https://drive.google.com/open?id=0B9Ud1oy4LsimNWxTSml5clFfczg

To end on a positive note, it now is possible to export a PDAS table to CSV format file, and that is a plus. (Look on PDAS output down at the bottom of the resulting PDAS table for a link to create the CSV file, near the documentation of the date of your run and the dataset used.)

We'll have to see whether we can get our friends at SAMHSA to restore functionality and utility of PDAS to the level of the former R-DAS, but the lesson for today is that the restricted data portal has become more central to anyone wishing to harvest new evidence from this important public health research resource. Given a choice between PDAS as presently constituted versus offline SDA dataset analyses, I'd always choose the latter, unless someone can show me PDAS variables not in SDA version of that dataset, or someone comes up with a good reason to favor PDAS. At present, not sure why it was commissioned. Seems redundant with online analyses via the ICPSR portal. 

[No sign of a batch option. Clunky point and click, and I could not find a way to type in known variable names, nor to recode a variable. Alas. A backdoor for recoding might be found by using a CONTROL variable as in my network failure example, but with taking advantage of informatively combined variables. For example, there is a variable for cannabis CF conditioned on (gated by) use in the year prior to assessment. Put the CF variable in the Row position, put the age of first cannabis use in the Column position, and put the AGE2 variable in the Control position. In this way, you might be able to estimate the fine-grained age-specific occurrence of the CF for newly incident users who started two calendar years before the assessment year, versus the occurrence of CF for newly incident users who started in the calendar year before the year of assessment, unless network failure is encountered. Here, the trick would be to take the analysis-weighted-age-specific numerators for each CF from PDAS, age by age. Repeat for MJFLAG to get weighted number of ever users as of each age in that year, with approximations when AGE2 is binned.  Then get the age-specific population count from the US Census, subtract the ever users from the age-specific census count, add back in the weighted number of newly incident users so that the "at risk" count grows properly, and form the ratio of the weighted number of newly incident users with CF, age by age, in each numerator and the size of the "at risk" population, age by age in the denominator. The PDAS would give you this for 12-21-year olds, and you could check your derived (concocted?) estimates against those values, but it would give you a way to study the age-specific cannabis CF incidence for age by age subgroups older than 21 years. Come to think of it, you can do this in SDA more readily, so why do it with PDAS until PDAS gets more variables not in SDA.]

Oh well.


Wednesday, November 9, 2016

Statistical Power in Evaluations That Investigate Effects on Multiple Outcomes

http://www.mdrc.org/sites/default/files/EC%20Methods%20Paper_2016.pdf

Interesting guide for researchers.
Discuss with others.

Treatment selection

NPR Unbroken Brain from July 2016


Alas, there is more heterogeneity than one case report signals.

For some people, the tough approach is needed.

This is can be approached as a treatment selection problem for which there are quantitative approaches:

This article by Manski is a useful starting point for some, but you may wish to start with more elementary problem set-ups as in the Wooldridge text or in this short summer course:

http://econ.msu.edu/estimate/

http://econ.msu.edu/estimate/registration.php

Wooldridge: Sixth edition: 

Introductory Econometrics: A Modern Approach