Back to Community
Paper Trading - Looking For Feedback

Hey everyone,

We want to hear from you about a change we are considering making to the Q platform. In short, we are considering removing paper trading, because it doesn't align with other features on the platform like it used to. More specifically, we want to provide data and features to help the whole community research and develop more contest and fund algorithms. Paper trading doesn't allow you to use datasets with a holdout (rendering it less useful), it doesn't align with our investment team's new approach to running the Q fund, and it is a costly feature to maintain (focus, money, and engineering time). We would especially like to reallocate that effort to helping you find and develop better algorithms.


History of Paper Trading

A couple of years ago, we removed live trading from Quantopian. It was an extremely difficult decision that impacted many of our community members. Our reason for removing live trading was that we wanted to focus on our investment business, and we noticed that algos for live trading split that focus both in our community and internally. Taking that one step further, we launched a new contest (the current one!) to align better with our investing focus. With two years of out-of-sample data on that decision, we feel like we made the right choice. As painful as it was at the time, the Q community has stepped up to the challenge of the new contest, used new datasets as they get added to the platform, and collaborated on ideas and best practices for developing a contest or fund algo (example 1, example 2, etc.).

At the time of removing live trading, we decided to keep paper trading. There were a couple of reasons to keep it, including easing the transition for folks who were using Q to do live trading as well as the fact that we depended on paper trading to test algorithms before running them in the Q fund. Today, we don't have the same live trading community that we used to and we no longer depend on paper trading to test fund algos]. Additionally, the FactSet datasets that we've been adding to the platform have the most recent year or two of data held out, which means they can't be used in paper trading. At this point, we feel that paper trading is not a feature that supports the research and development of contest & fund algorithms, so we are looking into removing it by the end of the year**.

** Note that we haven't committed to a specific date yet.


That said, before making a decision one way or the other, we'd like to learn more from you about how you use paper trading. We're curious about how you use it generally and also specifically if you think losing the feature would have an impact on your research and development process for contest & fund algorithms.

Let us know!

Disclaimer

The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by Quantopian. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. No information contained herein should be regarded as a suggestion to engage in or refrain from any investment-related course of action as none of Quantopian nor any of its affiliates is undertaking to provide investment advice, act as an adviser to any plan or entity subject to the Employee Retirement Income Security Act of 1974, as amended, individual retirement account or individual retirement annuity, or give advice in a fiduciary capacity with respect to the materials presented herein. If you are an individual retirement or other investor, contact your financial advisor or other fiduciary unrelated to Quantopian about whether any given investment idea, strategy, product or service described herein may be appropriate for your circumstances. All investments involve risk, including loss of principal. Quantopian makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances.

20 responses

Jamie,

Paper trading is the best out of sample test of the strategy you developing.
I 've been using it for over four years.
I only keep there those who meet my expectations, the best of the best algo.
Now there are about 20, the oldest have run for more than 3 years.
This is very important to me Quantopian tool.
Lately I prefer to watch the best of the best end of day the in reaserch notebooks.
Removing paper trading wil be a big hole for my ability to analyze intraday breath indicators
as ADV, DECL, UNCH, UPVOL, DNVOL, XVOL, TRIN, BRIN...and their inpact on next day market movement.
There is more infirmation then in 95% of fundamentals.

Save it please.

Jamie,

Instead of removing paper trading, you can simplify it and clear the load from inactive users:
If you show statistics of the last minute on the Dashboard, you can easily delete the Statistics sheet.
You can limit the visible Orders and Fills to the history of 1 day.
You can limit the visibility of journals to 1 month.
But most of the effect will be from this:
Email 200000 Paper users, to confirm their paper accounts within a month, otherwise
they will be closed.
I bet you will have no more than a thousand answers - 95% load reduction.

and the wolves are fed and the sheep are safe

Paper trading is the last thing that keeps me active on Q as I use it for live trading. Although I won algo contest awards twice, the general restrictions around algo design do not match my style and I do not currently participate, hoping they will become more liberal over time. In the meantime, I enjoy working on new ideas and checking the forums.

Another issue is that these kind of breaking changes make Q look bad, similar to Google, where products and features suddenly disappear. I was on a sales call for Q Enterprise and this is what I literally asked the poor sales person (if I buy Q enterprise will I get all the features that I have now guranteed) and they could not answer. This is one of the reasons I didn't go forward with that.

In another words, Q's "sharpe ratio" is in question. While 'returns' are great (features), the volatility is also large (changes). It would be better that it was more like Amazon where I know I can trust the platform long-term.

Find a way to save it.

ps. I do see a progress in Q's attitude that I want to commend, with live trading the feature was just removed with 30 day notice, at least this time you are asking the community for opinion.

keep it, thanks.

current contest has many restrictions, i know you have many considerations for that design, but indeed it is not friendly.

paper trading is more useful than contest algo.

I don't see it as a zero-sum game. The more time I spend on the Quantopian platform, the more ideas I produce, the better I understand markets and trading, the better my submissions will be. When Quantopian shut down live trading, I probably didn't use the platform for half a year or more, as my focus got diverted elsewhere (including getting immersed in setting up my own trading platform, as well as simply being discouraged that my algo trading hobby was being such a pain and focusing on other hobbies instead). Quantopian removing that feature didn't lead to my focus no longer being split. Today I am still algorithmically trading my own account -- but now that means much of my focus is diverted to other toolsets/platforms. From Quantopian's perspective -- my contest and fund submissions have been set back six months, at least, and have taken more of a backseat.

The paper trade is another one of these features that, while perhaps no longer directly contributing towards Quantopian's ends, makes the platform more sticky. It is a feature that I do use, draws me to the platform, and while I'm here I also try out some contest ideas, run some backtests, chat on the forum, and check in on my contest entries. The paper trade gives us something to keep track of in real time, which is nice, since otherwise everything else happens on the scale of days, weeks, half-years. Humans aren't built to be engaged with things that happen that slowly. With the contest not updating more than once a day (and sometimes a couple weeks elapsing between updates), it's nice to have the option to check in and see how our strategies are performing. I still use Quantopian to backtest ideas for my own trading, so I also have been comparing my live trading results side-by-side with the same strategy paper trading on Quantopian so that I can better understand what kinds of assumptions (or mistakes) are baked into the fill model and minute-resolution model. It's also actually very valuable to me to validate that everything is running as it should be, data is as it sound be, trades are executing as they should be, etc. I also use it to debug. While it's possible to dig through the EOD logs and do the same, it's just not the same. For example, I can thank the fact that I was watching the paper trade in real-time for realizing that one of my self-serve datasets was stale. In hindsight there were other ways I could have discovered that, but I don't necessarily have that kind of foresight. The paper trade offers a unique lens into what an algorithm is doing.

So while most of what I use paper trades for is not directly for the contest or fund, it is keeping me engaged in algorithmic trading and alpha and understanding markets and all the things that could lead to a killer submission.

With the paper trade gone, more of my time and energy will once again be diverted elsewhere.

I am on this website to develop algorithms because it is my hobby and I enjoy doing it. All of my 200+ posts, community interaction and contest entries have come about as a result of the features of the platform. I'm not here purely to develop (for free!) for a faceless company with millions of dollars backing them. In return for us doing the work of paid quants for you, you guys provide us with the tools to do it (democratising wall street as it was)

The process of development relies on paper trading to check out of sample returns and to check if everything is working as designed. To be completely honest, if the paper trading had been removed with live trading I would not be on this website anymore and would have long moved over to a competitor.

If costs are an issue, Vladimir put forward a ton of great suggestions. Potentially you could also limit the number of live algo's someone can have to 5-10 per person. As it stands however, removing paper trading is just going to lead to a lot of the active 'quants' leaving to QuantConnect or similar.

If the paper trading functionality is removed then next will be the order type functions in backtesting, so only MaximizeAlpha() can be used. Get ready for removal of limit orders, order_target, percent, etc. Then get ready for removal of stock data outside of QTradableStocksUS.

This platform now is a focus on the enterprise's needs over the individual's needs. That wasn't always the case. It's free so who is anyone to complain. The contest is an extremely specific product to leverage the heck out of low vol strategies as an optimization problem, limited to ~2000 stocks, to which we can't access the source code. A new or current quant/researcher striving to make a living trading would not be putting forward their best interests focusing on the contest or this universe of stocks.

Why not re-establish live trading as a paid service along with data subscriptions then, even as a separate entity? If you offer it to enterprise you surely can offer it to individuals. If you enable the individual, you enable a community. It appears you're going the other way. And for those who say "its a hedge fund" - I don't know of another hedge fund that licenses out their platform as 'enterprise.'

I'd be ok with paying Quantopian 10% of profits for live/real via Robinhood. If a lot of us did well in that where constraints wouldn't be in play, it's always possible Q might notice some approaches that could possibly be considered for adopting into the contest.

Active users keep using their time(that's our money) to contribute to the platform and hand over good ideas/algorithms, but you guys keep removing some good functions that benefits the users. I dont see it is fair enough. Quantopian is actually better than others like Quantconnect, mainly the stock screening system. I have already put some non-pipeline algos to Quantconnect. I could see one day they or other platforms improve it and the remaining users here will leave.

I also wanted to add -- I've been using the paper trade to keep at the fore of my attention potential contest/fund entries as they collect OOS performance stats. I can keep track of how they unfold. And I won't forget them. Sure, I could mark it on a calendar six months from now to check in and run a backtest to check the OOS, But six months is a long time and I could miss it and the idea will be forever forgotten.

Live trading would be a good feature to add. Q can make good money if it adds in paid commercial and retail trading

You will lose almost all of your community if you remove paper trading. It’s what makes Q unique and interesting to people here.

If you need to get the operational costs off the P&L, get creative about spinning off what you have. I don’t know what the financials are, but there may be an ad funded way to make it worth the effort.

Best, LP

I do not use paper trading, so my opinion might not have value.

However, if some use it, and the cost is not that prohibitive, then for sure, Quantopian should keep it alive.

Quantopian looses members every day. Sure, new ones come in all the time. But if the experienced contributors to the community go because they lost a service they liked, it is the whole community that is losing on that deal. Just like when live trading was put down.

What Quantopian needs to do is keep its community alive and vibrant. I find it incredibly generous of all forum participants to post advice, points of view, backtests, tearsheets, algos, but maybe most of all their vision of what they do or intend to do. I read almost every posts, and cannot wait to read what my favorite authors will say.

So, keeping anything that supports their research, their motivation and their interest should be welcomed. It is not just a few of the community that benefits from this, it is all of us. And, in the long run, it is Quantopian that will benefit the most.

I use it to run models that i have in contest and also to test models that don't meet contest but are of interest to me. What's interesting is that papertrade has revealed issues with the platform that weren't apparent in backtest (Dan Whitnable can attest to this). Papertrade got me interested in this platform. For the record, I'll be very sad if you end it.

@Jamie

There are a few common themes in the responses here. It would be good for Q to address this.

If paper trading were taken away, I don't think I would come back much - except to view other's posts.

I figured that this day was coming and I have tried to port over as much of my library/algorithms to other trading platforms (IB/Tradestation). I still use some live paper trading algos for live trading that I check on each day.

I can even see the reduction in activity since live trading was cut. I believe this would probably be the death of the majority of the remaining users - though I'm sure some will stay and continue to research. But again we keep getting the hint that Quantopian is not here for the small investors like me.

@Jamie,
Truth be told, I forgot about the paper trading feature, as I was sure it would go away soon after the live trading went away.
Well...two years later and here we are...paper trading is still alive!

I just started running one of my algos under paper trading, and was pleasantly surprised how well that works!

I can see using paper trading for:
1. Factor validation, including those factors that aren't currently contest conformant or winners, yet are viable Q allocation factors. This matches up with the current mini-contest being run by @Wiecki.
2. Can also use it as a validation of live-running strategies that are much simpler than the current contest.(e.g. long-only, less-than 100 assets, or smaller co-integrated strategies).

Bottom line (my co-integrated pair of cents): Keep it if you want to expand your search-for-alpha to other than the current contest massive long-short strategies, and want to peripherally support your user's real-life trading to entice them to do the contest-like research.

alan

"Leveling Wall Street's Playing Field" indeed.

Respectfully consider this... I've been inspired to write contest algos while discovering my own less strict small scale alpha (that I'm able to trade) as well as vis versa. At the end of the day, we all want to pull money out of the market - stopping papertrade makes that opportunity seemingly less possible. I've actually thought it over long and hard (I was in mourning for 24hrs) and if the only reason to come to the site is to develop strict contest algos, I'll sadly spend less time here. I've found interesting alpha out there that doesn't wholly meet Q criteria but I do always aspire to fit to the Q constraints. Yin Yang. I for one, will be unfulfilled, if I never get to win the contest:(

Keep the paper trading please!