Saturday 15 August 2015

When email marketing campaigns go awry: Q&A with Austin Jelcick of Cyagen Biosciences

Earlier this week I received an unsolicited email messagefrom a company called Cyagen Biosciencesinviting me to cite its “animal model services” in my scientific publications. By doing so, I was told, I could earn a financial reward of $100 or more. And since the amount would be based on the Impact Factor (IF) of the journal in question, the figure could be as high as $3,000 — were I, for instance, to cite Cyagen in Science (IF of 30). 
Austin Jelcick
The email surprised me for a number of reasons, not least because I am a journalist/blogger not a scientist. As such, I have never published a research paper in my life, and have no plans to do so. Moreover, I have only the vaguest idea of what an “animal model service” is, let alone how I would cite a company selling such a service in a scientific paper.

But mostly I was surprised that — at a time when thousands of researchers are calling for the abandonment of the Impact Factor — any company would want to tie its reputation to what is widely viewed as a sinking ship.

Curious as to why I had received such a message I searched on the Web for the company’s name, only to find that the link from Google to Cyagen’s home page delivered an error message.

Eventually locating an email address I contacted the company and asked if it could confirm that the message that I received had been sent on its behalf (It appeared to have come from a direct marketing company called Vertical Response).

The next day I received a reply from Cyagen product manager Austin Jelcick, who explained that I had received the message “as part of our marketing campaign which is currently seeking to raise awareness within the scientific community for our citation rewards program.”

As I was associated with “several blogs and articles related to open access journals and publishing” he added, it was assumed I would be interested in “our newly launched campaign to actively reward scientists for citing us in their materials and methods section while simultaneously encouraging them to submit into higher impact journals for increased awareness of both their study and our services offered.”

He added: “we felt that it would be beneficial to the researcher to receive a sort of ‘store credit’ for doing something they already must do as part of the publication process.”

Now intrigued, I invited Jelcick to do an email Q&A so that he could explain in more detail who the company was and why it had launched this campaign.

Very surprised by the offer


While I was swapping questions and answers with Jelcick by email the company’s campaign was starting to attract a good deal of commentary on the Web.

Yesterday, for instance, high profile physician and science writer Ben Goldacre published a blog post entitled, “So this company Cyagen is paying authors for citations in academic papers”.

Goldacre concluded, “Perhaps my gut reaction — that this feels dubious — is too puritanical. But I am certainly very surprised by the offer.”

Goldacre’s intervention also sparked a postover on Retraction Watch entitled, “Researchers, need $100? Just mention Cyagen in your paper!”

By now there was also a steady stream of comments from scientists on Twitter, expressing everything from puzzlement to outrage — see thisfor instance.

By late yesterday Cyagen clearly felt the need to make a public statement, which it did by means of a Q&A on Facebook, explaining: “Please find below some of the questions which were asked of us and our response which should help clear up the misunderstanding which has occurred about this promotion.”

The post went on to list seven questions and answers. What the company did not explain, however, is that these had been extracted from the interview I was still in the process of doing with Jelcick. That is, Cyagen did not cite me!

What has become clear is that the company believes that its email invitation has been misunderstood. Linking to the Facebook post from a comment on Goldacre’s blog, Jelcick went so far as to complain that Cyagen has become a victim of “some gross miscommunication”.

Richard Van Noorden appears to agree, saying on Twitter that the story has been “gleefully badly reported”. He explained: “you can’t get $100 by citing them. You get a discount voucher for their products”. He nevertheless suggests that Cyagen should withdraw the offer “pronto”.

It would seem that the mistake Cyagen made was to link its promotion to the much-maligned Impact Factor, which has become a red rag to many scientists. (See also the first comment below).

Anyway, below is the full list of 17 questions and answers that make up the interview I did with Jelcick. Some of the answers are a little repetitive, but given the confusion surrounding Cyagen’s email I have chosen not to edit them.

See what you think.

The interview begins …


RP: Can you say something briefly about Cyagen Biosciences and your role in the company?

AJ:Founded in 2005, Cyagen Biosciences Inc. is a 200-employee contract research organization and cell culture product manufacturer with offices in Silicon Valley, California and China, and production facilities in China.

As a leader in custom animal models and molecular biology tools, Cyagen prides itself on the mission of bringing outstanding-quality research reagents, tools, and services to the worldwide biological research community at highly competitive prices. 

My role at the company as Product Manager ranges from marketing materials development, product/service seminars and presentations, technical support and scientific support on our animal model projects as well as our vector construction projects, and also general customer service to ensure our customers receive the best support while simultaneously delivering the highest quality products and services.

RP: In which country/state is Cyagen registered and who owns the company?

AJ:Cyagen is a privately held company with a US office and base of operations in Santa Clara, CA as well an Asia Pacific office and base of operations in China, with production facilities in China as well.

RP: Are you not able/willing to say who owns the company or where it is registered (as in where it files its accounts)?

AJ:Cyagen is registered in both the US (California) as well as China. I am unable to provide further details of ownership aside from it being privately held.

RP: On 11th August I received an unsolicited email message that appeared to come from a direct marketing company called Vertical Responsesaying that Cyagen was offering to pay me to cite its “animal model services” in my scientific publications. If I did, I was told, I would get a payment based on the Impact Factor of the journal in question. In the case of a journal like Science, it added, this would be $3,000. Can you point me to a web page containing the full details of the offer?

AJ:The Citation Reward Program does not offer payment for citations, but rather a store credit voucher good for future purchases of products and/or animal model services from Cyagen for researchers citing us in their publications.

We are not asking researchers to do something that they will otherwise not do. In fact, when a researcher publishes a paper, they are ethically required to disclose in their publication the outside reagents and services they received that contributed to their research findings, including those purchased from commercial entities. Our voucher is just a way of thanking them for using our products and services that ultimately led to their published scientific findings.

It appears that our email has caused misunderstanding as to the nature of, and how we wish the researchers to respond to, the voucher. As such, we extend our full apologies to you and other researchers for the misunderstanding caused by insufficient clarity in our email. Full details on the promotion can be found here.

RP: Is there a marked difference between offering to pay an individual for citing Cyagen and offering them a store credit for citing the company?

AJ:We believe so for two reasons. The first being that citing us in their publication is a standard ethical requirement for any researcher should they have chosen to utilize our products or services in their study initially and so they are being rewarded by means of a discount on future purchases rather than a personal incentive.

Expanding on this, the second reason is that we offer an incentive that allows for future research/studies to be performed rather than a personal incentive; this way it is the research institution and their studies which are benefitted.

RP: How many scientists have shown interest in/taken up Cyagen’s offer so far, and what are your expectations here (presumably you have set aside a sum of money to cover the payments)?

AJ:Since the promotion’s launch in July, we have had only a few researchers contact us regarding the program. Again, no money is set aside as researchers are not being given financial compensation but rather store credit for future purchases.

Given that researchers who utilize our services are required to disclose the source(s) of all reagents and services used in their research when publishing a journal article, we would hope that our existing customers would take advantage of the promotion and become return customers, while new customers may be more likely to choose us over a competitor for being rewarded for something they already must do as part of the publication process. 

Why did I receive this invitation?


RP: I am actually a journalist/blogger rather than a scientist and so have never written a peer-reviewed paper. Why did I receive this invitation?

AJ:Our marketing and business development teams do their best to find researchers or associated individuals (i.e. Lab managers, purchasing personnel, etc.) who are actively seeking and/or purchasing reagents and laboratory services for their research.

Due to the nature of your blog (which covers peer reviewed publications and open source journals) our staff assumed that you were involved in active publications or research leading to peer-reviewed publications.

RP: What are “animal models” by the way? Is it that Cyagen breeds rats and mice and sells them to labs for experimentation, or am I misunderstanding?

AJ:Animal models are just this: model organisms for the study of diseases and underlying biological mechanisms for the development of novel therapeutics for both humans and animals (domestic, livestock, etc.). The animal models we produce are custom engineered for the researcher based on their study.

For example, a researcher may be studying the effects of a drug on weight loss during a high fat diet and may think that Gene X may cause some sort of increased/decreased response to the drug. The researcher would then look for a mouse/rat model where Gene X is missing or overexpressed, and after contacting us, we would engineer a genetically modified mouse/rat lacking Gene X or over expressing Gene X for their studies.

RP: So my understanding was right: When you say “The animal models we produce are custom engineered for the researcher” you are talking euphemistically. An animal model is a live rat or mouse, and when you say you “engineer” animal models you are referring to a process that a layperson would call “breeding” an animal?

AJ:Yes and no. “Model” is not a euphemism but a standard term in the field, which refers to modelling a disease state or condition.

Breeding the animals is a step of the process however. To initially develop the animal models a variety of genetic engineering techniques are used including constructing synthetic DNA fragments and subsequently injecting these into an early embryonic stage of development so that they integrate with the animals’ DNA, subsequently creating an animal with foreign DNA or with portions of its DNA altered.

Also, the embryos and animals which are originally used are inbred laboratory strains such as ones you would find at a variety of animal providers or university core facilities. If you would like more information on these animal models, there are a variety of good articles on Wikipedia among others on transgenic and CRISPR mice.

RP: What is your understanding of the Impact Factor, how it is calculated, and what it measures?

AJ:Generally speaking, an impact factor (IF) is a metric used to gauge the amount of times articles in a given scientific journal are cited, thereby serving as a proxy for the journal’s importance within its field of study.

This can be calculated in two ways. The first is the number of citations in a given year to articles published in the previous two years (A) divided by the total number of articles published in the prior two years (B). A/B = IF.

The second is similar, but removes the number of self-citations (C) from (A) prior to division by (B). (A-C)/B = IF.

For example, if in 2012 Nature was cited 250 times for articles published in 2010-2011, and it has cited itself 75 times, and a total of 100 articles were published in 2010-2011, then its corrected IF would be (250-75)/100 = 1.75.

Citing products not papers


RP: To clarify: Cyagen is asking researchers to cite its products, not papers written by its employees? If that is right, then presumably this is not about traditional citation boosting , but paying scientists for what amounts to “product placement”?

AJ:The goal is not product placement but rather: (1) to increase the number of publications featuring Cyagen as a product or service provider to add strength to our company’s reputation and visible experience; (2) to reward researchers for performing a task that is already required of them as an extra way of saying thanks for choosing us as a service provider to begin with.

Researchers already must (ethically) disclose in their publications any references cited, any sources of reagents and services, and any collaborations. Should a researcher purchase cell media from Company X, and mouse breeding services from Company Y, while collaborating with Professor Z, they would have to disclose this in their publication so that all entities receive credit for their contribution to the study.

Additionally, most studies are not “endpoint” studies so to speak, with many having follow up studies to determine further details.

As a result, it is beneficial to a researcher and their laboratory budget if they receive a store credit for their next purchase as a reward for their initial purchase and subsequent published paper as this decreases the cost of their next study. This is similar to receiving coupons after a purchase at a retail store good for use on the next visit.

RP: Do you feel that there are any ethical issues involved in offering to pay researchers to cite products in their papers?

AJ:Again, we are not offering to pay researchers to cite our products or services, but rather we are offering them an incentive to become a repeat customer. Rather than offering a discount on a current order (which we have done as part of other promotions) we are offering a discount by means of a store credit on future purchases.

Because of this, we do not feel that any more ethical considerations are raised than if we were to offer discounted services from the beginning to gain customers’ interest in choosing us over a competitor.

RP: When I contacted you about the message I was sent you replied that Cyagen was encouraging researchers “to submit into higher impact journals for increased awareness of both their study and our services offered”. The ethics of paying people to cite Cyagen products in research papers aside, do you not feel it to be a somewhat retrograde step to encourage researchers to chase after Impact Factors at a time when many are calling for the downgrading or extinction of the Impact Factor? For instance, over 12,000 researchers and nearly 600 organisations have signed the San Francisco Declaration on Research Assessment recommending that the research community should not “use journal-based metrics, such as Journal Impact Factors, as a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring, promotion, or funding decisions.”

AJ:The encouragement of researchers to seek higher impact factor journals is based on the existing academic thought that impact factor still is a somewhat relevant metric for assessing the importance of a given journal or article, simply because it is based on the number of times a paper/journal is cited by other publications.

This being said, impact factor is just that: a metric. The number of times a paper has been cited does not necessarily reflect the quality or integrity of a publication or journal, as many researchers are aware of pioneering and ground-breaking studies which were looked over at the time of publication but years later came into popularity and prevalence.

As many researchers still actively look to publish in large, popular journals simply due to their exposure and subsequent citations by other researchers in order for their own studies to gain exposure and relevance, we felt that offering store credits to researchers for something they already were doing or attempting to do was a sort of easy and simple method for researchers to obtain discounts on future orders as opposed to discounts requiring minimum purchases, quantities, etc.

Unscientific and deceptive?


RP: The point critics of the IF make I think is that while it may say something about some of the papers that a journal has published over a specific time period, it says very little (or nothing) about an individual paper published in that journal. Is it not the case, for instance, that a paper published in a high IF journal may receive no more — and possibly fewer — citations than if it were published in a small specialist journal with a low or no IF? Is that not the reason why there is now a strong movement against the use of the metric: it tells you little or nothing about the quality of an individual paper? If so, is not Cyagen encouraging researchers to engage in a practice that it is now widely held to be unscientific and deceptive. Would you agree with that?

AJ:You are correct in your statement regarding a given article within a given high (or low) impact journal. Ultimately the impact factor of the journal does not directly relate to the quality or number of citations any given article in it may have or receive.

As someone who has previously published in open source journals (PLOS ONE) I would also add that there are a number of high quality articles and studies in smaller open source journals, and that a higher impact factor journal may have the same number of high quality studies as any other journal.

The IF metric however is not deceptive or unscientific, it is simply one measurement of a journals’ relevance to the field it is a part of. It may be going too far to say it has no relevance to the quality of the paper as high impact journals tend to have a higher “level of entry” but is not a perfect metric. Similar to any survey or poll which attempts to measure a general trend, opinion, or importance, it must be taken with a grain of salt and in conjunction with other metrics for a true observation to be drawn.

Our citation rewards program in its current state is our first attempt at rewarding researchers for performing an aspect of research which they normally do already as an attempt to gain repeat customers. As we receive more feedback on the program, we may update and alter the program so that the promotion details are clear and that all previous customers (who actively publish studies) receive credit towards future purchases.

RP: Here is what I still don’t quite get: you said that researchers are “ethically required to disclose in their publication the outside reagents and services they received that contributed to their research findings, including those purchased from commercial entities.” You also said “We are not asking researchers to do something that they will otherwise not do”. Why then would you go to the effort of emailing them to say, “We are giving away $100 or more in rewards for citing us in your publication!” And why would you say to me when I contacted Cyagen that the aim is to “increase the number of publications featuring Cyagen as a product or service provider”.  I hear what you say about wanting to thank people for being customers and encourage them to buy again, but would it not be better to focus on improving your products and your customer service than paying them for doing something you say they are bound to do in any case? More pertinently perhaps, is it wise to link your offer to something as controversial as the Impact Factor? As I think you acknowledged, researchers have not responded too well to the offer. Here are some of responses on Twitter: one, twothreeand four

AJ:As I mentioned, we are constantly looking for ways to improve the promotion as well as new promotions. As we receive feedback from the research community, we will update promotions accordingly so that they are both beneficial and clear without cause for any sort of ethical concern. Impact factor was initially decided upon based on its historical usage by the research community. Based on feedback, we may alter the promotion to simply offer a store credit for each publication, independent of impact factor.

With regards to the previous statement about our aim to “increase the number of publications:” We frequently receive inquiries from new customers requesting references or citations from researchers who have utilized our services in the past, and do our best to list all publications (found through periodic PubMed queries) citing us on our website as a reference. By offering this promotion researchers will actively reach out to us to inform us of their latest study and publication allowing us to update our citation/reference database more quickly, thereby increasing the number of publications in which we are cited available for viewing and reference by new customers.

Additionally, although researchers are ethically required to disclose all sources of reagents, services, and collaborators in their materials and methods, they may not always remember to this. So the promotion serves a dual purpose as a reminder to do so.

Error message


RP: I received the marketing email two days ago. When I searched on your company name I found the home page but when I tried to access it I was told it was down. It is still down as I write this. Were you aware that your home page was giving an error message?

AJ:Our staff has been unaware of any down time suffered by our website as we have not received any reports of downtime by either customers or staff members utilizing the website this week including today.

It may have been the result of an improper link or URL. The website is available at: http://www.cyagen.com/us/en/

RP: Perhaps it is because I am based in Europe, but if you search “Cyagen Biosciences” on Google and click the first hit that comes up you get the following result:


That is how it has been for the past few days, and I am still getting the message as I write this follow-up question. I am not sure this could be described as an improper link because the URL that Google has indexed (and which is not working) is www.cyagen.com/. This would seem to me to be likely to conspire against Cyagen attracting many new customers to its services. Would it not be better to focus on improving the way that customers find you than mass mailing them and offering to pay them for something they have to do anyway?

AJ: This is the first report of any downtime of our website in Europe, and we thank you for providing a screenshot of the error which occurred (we will forward this to our IT team to solve the issue as soon as possible). This may be a regional DNS error as well as we have not had any reports of errors within the US, Canada, or the Asia Pacific region (see below for screenshot from US based inquiry).

Mass emailing is only one small aspect of our marketing strategies. We are actively engaged in optimizing our website as the newest revision just launched this summer, including SEO and relevant keywords, in addition to various promotions.

The citation rewards program is just one of several current promotions including free vector designs for nuclease based animal projects, reduced pricing for more popular mouse strains, and more.

Additionally, we have regional sales representatives who visit universities and companies on site for seminar presentations as well as attend vendor shows to enhance our customer exposure, and are constantly looking for new and innovative ways to expand our visibility.





Wednesday 12 August 2015

Open peer review at Collabra: Q&A with UC Press Director Alison Mudditt

Earlier this year University of California Press (UC Press) launched a new open access mega journal called Collabra. Initially focusing on three broad disciplinary areas (life and biomedical sciences, ecology and environmental science, and social and behavioural sciences), the journal will expand into other disciplines at a later date.

One of the distinctive features of Collabra is that its authors can choose to have the peer review reports signed by the reviewers and published alongside their papers, making them freely available for all to read — a process usually referred to as open peer review.

This contrasts with the traditional approach, where generally the reviewers names are not disclosed to the authors, the authors names are not disclosed to the reviewers, and the reviewers reports are not made public (commonly referred to as “double-blind” peer review).

Since Collabra is offering open peer review on a voluntary basis it remains unclear how many papers will be published in this way, but the signs are encouraging: the authors of the first paper published by Collabra opted for open peer review, as have the majority of authors whose papers are currently being processed by the publisher. Moreover, no one has yet refused to be involved because open peer review is an option, and no one has expressed a concern about it.

Collabra’s first paper—Implicit Preferences for Straight People over Lesbian Women and Gay Men Weakened from 2006 to 2013was published on 23rdJuly, and the reviewers’ reports can be found here.

So how does open peer review work in practice and what issues does it raise? To find out I emailed some questions to UC Press Director Alison Mudditt, whose answers are published below.
Alison Mudditt


RP: Presumably both the author and all the reviewers have to agree to open peer review before Collabra can publish the reviews? What percentage of the papers it publishes does Collabra expect will have the reviews published alongside?

AM: Authors choose open peer review as an option upon submission, so it is always their decision and as such they have already agreed in advance. Reviewers are made aware that authors have chosen this option and could opt to decline the review if they are unwilling to have their review comments made publicly available.

As a secondary option, whether or not open review has been chosen by the author, reviewers can sign their reviews. So it is possible to have reviewer comments be open, but the identity of the reviewer remain anonymous. Or, for that matter, have closed review, but reviewers sign their reviews. This is all described here.

With only one published article it is hard to project what the percentage will be, but at this point the majority of authors—for the papers currently being processed in our system—have opted for open review.

We are not targeting certain percentages, but rather want to put new options in front of people, especially given the numerous critiques of traditional closed peer review systems. This will not be for everyone, but we believe there’s much to be learned from experimentation with new models.

RP: Will Collabra make any effort to seek out reviewers who are comfortable with open peer review?

AM: The academic editors are selecting reviewers, and their top consideration will of course be the reviewer’s expertise for any given paper.

We make all the options and elements of Collabra clear when inviting external editors to be involved. Some editors are particularly interested in the open review option, and other editors have not commented on it.

No one has refused to be involved because it is an option or expressed a concern about this option.

RP: I assume that not all the correspondence is shared when Collabra publishes the reviews, and perhaps they might be edited in some way first (at least sometimes)? If so, what considerations/editorial rules are applied before making reviews public?

AM: Currently, the “open review file” is constituted by the reviewers’ comments on the reviewer form, the editor’s comments to the author based on the reviewers’ comments, and the author’s response—all as captured in our editorial system.

It is clear on the review form that there is an area for confidential comments to the editor that would not be shown to the author nor included in the openly available comments. But, for the remainder of the form, it is made clear that comments may be seen by the author and used without editing.

What is not currently shown is any earlier version of the paper and any comments or tracked changes on that. We will continue to monitor this policy and will consider other options, if it seems that useful or important elements are being omitted by not including earlier versions/changes.

And, obviously, if any discussion occurs outside of the editorial system between a reviewer and an editor, that will not be captured.

As regards editorial rules and considerations for any edits or omissions, we would discuss that with the editors as they came up. It is hard to say in advance what that might be (other than any information which is confidential and not even being revealed in the paper), so we’ll deal with that on a case by case basis.

Naturally, we would opt to be transparent about this happening should it occur beyond normal confidentiality considerations. For now we will see how it goes with it’s being clear on the form that comments may be used as written.

RP: Having started down this road (and so given concentrated thought to the matter), what would Collabra say were the pros and cons of open peer review?

AM: Speaking on behalf of UC Press (I’m not sure it’s appropriate to speak as “Collabra” in this context), we think that the inner workings of the peer review process are, purely and simply, interesting for any reader, but in particular for people who would like to see more transparency in this process.

There is clearly an argument to be made that making things open (rather than, for example, the double blind process) will help to reduce biases, problematic opinions, or hierarchical sensitivities that can affect the review process.

Equally importantly, open review starts to demonstrate the value added by the review process and to recognize the contributions of reviewers to scholarship

Finally, we all know that traditional peer review has not put a stop to whole disciplines being rocked by scandals of fabricated data and unquestioned results, and it’s possible that open peer review will actually help to improve the scholarly record.

On a related note, one of our other aims with Collabra is to get rid of the phrase “peer review lite” which has plagued the type of review that Collabra (and other OA titles) employs.

We characterize our review criterion as being “selective for credibility only”—checking for the scientific, methodological, and ethical rigor of a paper, and removing, as much as humanly possible, more subjective reviewing criteria for novelty or anticipated impact. Open reviews will support this mission—to show that there is nothing “lite” about this kind of review (and in fact, sometimes quite the opposite).

It’s too early for us to be able to identify specific problems with open peer review for Collabra, although we are aware of studies suggesting that it may be harder to get reviewers and it may lengthen the review time. Our limited experience so far does not support either of these concerns.

The other cons of open peer (as opposed to double blind) review are clearly to do with concerns about bias, the highly variable nature of peer review, and the additional costs it could impose on an already overtaxed system.

For example, a reviewer might be worried about openly and critically reviewing a more senior author and believe there could be a negative effect on her own career.

Our hope is that a more open system will improve the integrity of the peer review process, but the reality is that any system will be subject to the biases of human nature—we just think that this is more likely to be surfaced through greater transparency.

RP: Does Collabra think that there are occasions when open peer review is inappropriate? If so, when and why?

AM: Anything raised in peer review of a confidential nature which does not make it into the published article should be carefully removed from any open peer review comments that get published during open review.

That said, we (UC Press) are not really the drivers of how open peer review will evolve in Collabra or elsewhere. Since Collabra works only with external editors, editorial policies should emerge that are firmly based on the standards of each research community that publishes in Collabra.

If a community-driven majority standard emerged which stated that, in certain situations, open peer review was inappropriate, then we would respect such a decision.

RP: Are there any other learning points that have emerged as Collabra has sought to implement open peer review?

AM: It’s too early in the launch of Collabra to really be able to comment, although we have been pleasantly surprised at authors’ and reviewers’ willingness to consider the option of open peer review. That seems to be a great start for this concept.


An earlier Q&A with Alison Mudditt can be read here.