WatchLists / Evolving Watchlist

nalin

#1

2/8/2010 4:39 AM

I'm trying to create the equivalent of Watchlists which were available in WL 4.

Whats the best way of doing this ?

I assumed the best way to do this was to first create a DataSet and then add or remove symbols. But the difficulty I'm having with this approach is that after I add or remove symbols the button for "Apply Symbol Changes Above to Dataset" remains disabled....so I can't save the changes.

Eugene

#2

2/8/2010 4:56 AM

Install this Extension from our site: Aronow Software LLC Watchlist Static Data Provider

Some data providers don't allow modifying the DataSet after its creation.

DaveAronow

#3

2/8/2010 9:04 AM

I would like to add editing of symbols but I need the Wealth-Lab .Net API to be published and Fidelity is taking their sweet time getting it done. Call them to complain (see the other postings about this).

Dave

Eugene

#4

2/8/2010 9:41 AM

Without disclosing the unpublished docs re: ExtendedBehaviors (which I haven't seen anyway), here's my derivation in my own words:

1. Create a partial class that inherits from DataBehaviorUserControl. This will be your provider's tab inside the Data Manager. Here you read and write the provider settings.

2. In your StaticDataProvider class, notice an optional override called ExtendedBehaviors.

Create a List<DataBehaviorUserControl> object, instantiate your partial class (step 1) and add it to the List<>.

Update:

3. Wealth-Lab will use the Tag property of your UserControl for the tab's name.

nalin

#5

2/8/2010 9:04 PM

The extension by Aronow Software works perfectly. Thanx !

Sammy_G

#6

6/1/2010 10:56 AM

There appears to be a big limitation in the usage of this extension. Namely, you either add symbols one at a time, or select an entire dataset's symbols. So if I want to create a watchlist of say 1000 symbols from my master dataset which has 10000 symbols, I have to click 1000 times. Not my idea of fun.

Eugene

#7

6/1/2010 11:05 AM

If there's any chance that those symbols sit next to each other, use the standard Windows way of selecting with Shift key: select the first symbol, press and hold the Shift key, while holding the key down click the last item.

P.S. When you asked this question in support, I wondered: what would be your solution to it? How else a GUI program should know which items user wanted to select, without having to click on them?

Sammy_G

#8

6/1/2010 11:18 AM

My solution would be the way its done in v4, namely: You populate the symbol window (the one on the right) with a list of symbols you have copied from somewhere (e.g. a website), no need to be limited to selecting either one or all symbols.

WLTrader23

#9

2/3/2011 10:02 PM

I almost died and went to heaven when I found your Evolving Watchlist code with the IndexHelper. Just what I need to backtest the daily changes to my fundamentals watchlist. However, I can't get it to run properly. It keeps running the Dataset and not the symbols in the DAX files. The original code debug list verifies that when run without a strategy, it does give me the proper symbols on the correct dates. However when I add any type of Position Entry code, it runs the entire associated Dataset for the complete Date Range. Below I've put in a simple crossing moving averages to make sure it wasn't my added code, but still did not work. What am doing wrong? Perhaps the placement of my the Position Entry Code?

Size:

Color:

I almost died and went to heaven when I found your Evolving Watchlist code with the IndexHelper.  Just what I need to backtest the daily changes to my fundamentals watchlist. However, I can't get it to run properly.  It keeps running the Dataset and not the symbols in the DAX files.   The original code debug list verifies that when run without a strategy, it does give me the proper symbols on the correct dates.  However when I add any type of Position Entry code, it runs the entire associated Dataset for the complete Date Range. Below I've put in a simple crossing moving averages to make sure it wasn't my added code, but still did not work.  What am doing wrong?  Perhaps the placement of my the Position Entry Code?

[CODE]

using System;
using System.Collections.Generic;
using System.Text;
using System.Drawing;
using WealthLab;
using WealthLab.Indicators;
using Community.Components;namespace WealthLab.Strategies
{
	public class MyStrategy : WealthScript
	{			
		protected override void Execute()
		{
			IndexHelper ih = new IndexHelper( @"C:\Users\Michael\Documents\Financial Data\Folios\WLDynamicWatchlists\", "DAX", Bars );		
			DateTime firstDateAvailable = ih.FirstIndexDate();
			
			const int Period = 14;
			PlotSeries(PricePane, SMA.Series(Close, Period), Color.Blue, LineStyle.Solid, 1);
			
			for(int bar = Period; bar < Bars.Count; bar++)
			{
				if (IsLastPositionActive)
				{
					if( CrossUnder(bar, Close, SMA.Series(Close, Period)) )

SellAtMarket(bar + 1, LastPosition);
				}
				else
				{
					// Test it
					if( Bars.Date[bar] >= firstDateAvailable )
					{
						/*Removed the original debug code that properly displayed the symbols in the correct timeframe
						
						symbolList sl = ih.WatchList( bar );
						if( sl != null )
						{
							foreach (string s in sl.symbols )
								PrintDebug (s);
						}*/

if( CrossOver(bar, Close, SMA.Series(Close, Period)) )
							BuyAtLimit(bar + 1, Close[bar]);
						
					}
				}
			}
		}
	}
}

[/CODE]

Eugene

#10

2/4/2011 1:22 AM

That's right. What you removed is not the debug code. It's the symbol list representing the index composition for that bar(date). The system now isn't aware of the actual composition, and should execute trades on the complete watchlist.

dansmo

#11

2/4/2011 4:18 AM

try it this way:

WLTrader23

#12

2/4/2011 5:51 AM

I'm in heaven now and I didn't even have to expire. Also added back in the symbolList sl = ih.WatchList( bar ) statement and it works great even using intraday. Thanks a boodle.

WLTrader23

#13

2/4/2011 2:48 PM

When backtesting using the Evolving (dynamic) watchlist, is the Buy and Equity curve showing Buy and hold the equities during the period that they are in the watchlist or holding all equities for the entire date range?

Eugene

#14

2/4/2011 3:33 PM

Buy & Hold doesn't close positions - it takes an equal-dollar position in each symbol of the DataSet on bar 1 and holds them till the end. Dynamic DataSet composition won't affect B&H.

Cone

#15

2/4/2011 4:15 PM

Note that you can also elect to use Benchmark Buy & Hold in Preferences (F12) > Backtest Settings. Theoretically, you could create a Index symbol that that took into account a dynamic WatchList, but it would be easiest to use one like the S&P 500, Nasdaq 100, etc.

Nadja

#16

7/16/2012 6:45 AM

Hello all

To start with the idea of creating dynamic watchlists, I have taken the code from "Backtesting with Dynamic (Evolving) WatchLists" and tried to implement it. Howewer, I receive the message that the index should not be out of range or negative. I have tried to change denominations and involved folders, but it remains the same.

The folder Nasdaq_100_Files contains the text files for each year, from NASDAQ_19980101.txt to NASDAQ_20120101.txt.
The folder Nasdaq_100_Set_final contains the data for all the stocks that appeared in the index during this time, equally in txt format.

Does anybody know what I overlook?

Thank you in advance for any ideas.

Kind regards

Andreas

Size:

Color:

Hello all

To start with the idea of creating dynamic watchlists, I have taken the code from "Backtesting with Dynamic (Evolving) WatchLists" and tried to implement it. Howewer, I receive the message that the index should not be out of range or negative. I have tried to change denominations and involved folders, but it remains the same.

The folder Nasdaq_100_Files contains the text files for each year, from NASDAQ_19980101.txt to NASDAQ_20120101.txt.
The folder Nasdaq_100_Set_final contains the data for all the stocks that appeared in the index during this time, equally in txt format.

Does anybody know what I overlook?

Thank you in advance for any ideas.

Kind regards

Andreas

[CODE]using System;
using System.Collections.Generic;
using System.Text;
using System.Drawing;
using WealthLab;
using WealthLab.Indicators;
using Community.Components; /*** Requires installation of Community.Components Extension from www.wealth-lab.com > Extensions ***/

namespace WealthLab.Strategies
{
	public class MyStrategy : WealthScript
	{			
		protected override void Execute()
		{
			IndexHelper ih = new IndexHelper( @"C:\Users\Andreas\1MeineDokumente\1Börse\17Daten_Indizes_SB\Nasdaq_100_Files\", "Nasdaq_100_Set_final", Bars );			
			DateTime firstDateAvailable = ih.FirstIndexDate();
			
			for(int bar = 1; bar < Bars.Count; bar++)
			{
				if (IsLastPositionActive)
				{
					//code your exit rules here
				}
				else
				{
					// Test it
					if( Bars.Date[bar] >= firstDateAvailable )
					{
						symbolList sl = ih.WatchList( bar );
						if( sl != null )
						{
							foreach (string s in sl.symbols )
								PrintDebug (s);
						}
					}
				}
			}
		}
	}
}[/CODE]

Eugene

#17

7/16/2012 7:58 AM

Hello Andreas,

1. Please double check that your symbol list files follow the convention: one symbol per line, no headers, nothing else.
2. Quick debug question: would the PrintDebug() output of the "DateTime firstDateAvailable..." line be valid?
3. As the solution includes external variables such as the collection of symbol name data and the IndexHelper class, have you tried running the Strategy under debugger as shown here or here, depending on your IDE?

Nadja

#18

7/18/2012 7:58 AM

Hello Eugene

Thank you for your help, I could solve the problem from above.

Now, I am much further, one step from the goal. The idea is to integrate the dynamic watchlist in a rotation strategy, the same idea as discussed in ROC Symbol Rotation - Modification of the Strategy.

In my opinion, it should be possible to remove the elements from the buy list that are not on the watchlist in the main loop, but before the entry orders. The aim is that at each bar, an up-to-date buy list is created.

The method which should do this (see below) causes a runtime error, maybe it's just something about the classes IndexHelper or List<T> that I do not fully understand.

The detailed decription is in the code.

I would really appreciate any form of help. If you need to see the whole code, it's no problem, but I didn't want to bother with it, because it's quite long!

Kind regards

Andreas

Size:

Color:

Hello Eugene

Thank you for your help, I could solve the problem from above.

Now, I am much further, one step from the goal. The idea is to integrate the dynamic watchlist in a rotation strategy, the same idea as discussed in ROC Symbol Rotation - Modification of the Strategy.

In my opinion, it should be possible to remove the elements from the buy list that are not on the watchlist in the main loop, but before the entry orders. The aim is that at each bar, an up-to-date buy list is created.

The method which should do this (see below) causes a runtime error, maybe it's just something about the classes IndexHelper or List<T> that I do not fully understand.

The detailed decription is in the code.

I would really appreciate any form of help. If you need to see the whole code, it's no problem, but I didn't want to bother with it, because it's quite long!

Kind regards

Andreas

[CODE]public void KauflisteBereinigen(int bar)
		{
			DateTime firstDateAvailable = ih.FirstIndexDate();
			
			if(Bars.Date[bar] >= firstDateAvailable)
			{
				symbolList sl = ih.WatchList(bar);
				
// The problem is in the following part of the method! Without this part (in comment), the code works.
// But it is necessary to remove the objects of the class Titel from the buy list, if their tickers are not on the WatchList. 
// The runtime error is at:
// System.Collections.GenericList'1.Enumerator.MoveNext(), it says that the listing has been changed and that the enumeration may not take place.
				
				/*
				foreach (Titel titel in kaufliste)				
				{												
					if (!(sl.Contains(titel.GetSymbol())))		
					{
						kaufliste.Remove(titel);				
					}
					
				}
				*/
			
			}
			
		}[/CODE]

Eugene

#19

7/19/2012 3:09 AM

Andreas,

You should never .Remove anything from a collection you are iterating over while inside of a foreach loop. On the other hand, there are other ways to do the same thing:

Nadja

#20

7/19/2012 6:47 AM

Hello Eugene

Thank you for the competent answer!

With your loop, the whole code works, I just had to change line 4: if (!(sl.symbols.Contains ....)

Kind regards

Andreas

kyokushin

#21

12/22/2013 2:38 PM

Hi,

Is there a chance that I get the symbol list files mentioned in "Backtesting with Dynamic (Evolving) WatchLists" for NASDAQ 100 somewhere in the internet or do I have to create them myself?

Regards

Matt

Cone

#22

1/9/2014 3:40 PM

In the thread that Eugene will delete you asked...

I know that at one time Norgate was working on that product, but as far as I know, you'll still have to create those files yourself.

Here's some help for changes in the Nasdaq 100. Working backwards you should be able to create the files. (Although I should be able to write a script to do it today or tomorrow.)

Edit: Will correct and repost below..

vk

#23

1/10/2014 3:40 AM

You might want to contact them and remind them, here the URL: http://www.premiumdata.net
Please don't forget to mention that you using this fantastic piece of software called Wealth-Lab. ;)

Eugene

#24

1/10/2014 4:28 AM

Hey, does Nasdaq 100 always have a hundred components or maybe not? Or is the supplied list of changes incorrect? I've just written a parser which shows me that the number varies. Just a couple examples:

20091221: 8 stocks replaced 7
20030102: 20 stocks replaced 19

kyokushin

#25

1/10/2014 2:17 PM

I'm quite positive NASDAQ 100 always consists of 100 stocks. Perhaps the list is incorrect...

Eugene

#26

1/11/2014 2:07 AM

Also, the list of changes diverges with Nasdaq-100's own sometimes, like in 2003:

http://www.nasdaq.com/indexshares/historical_data.stm

Plus, WMFI replaces a stock twice (on 20101220 and 20030102) w/o being removed itself in the middle.

Cone

#27

1/11/2014 4:03 AM

We were missing this set of changes:
20081221; ADP FSLR LIFE ROST MXIM ILMN PPDI ORLY URBN JBHT WCRX replaced AMLN CDNS DISCA LAMR LEAP LVLT PETM SNDK SIRI VMED WFMI

Let's work on a corrected list and then repost.

Cone

#28

1/12/2014 7:49 AM

Below is the list for the Nasdaq 100 changes. Let us know if you see any errors.

Eugene will create the text files to work with the IndexHelper. Since data for many of the symbols are no longer readily available from most data providers, we'll probably need work with the PremiumData Delisted Securities symbology. Example:

This record:
20020724; LNCR +- WCOM

Would change to:
LNCR +- WCOEQ-200404

Eugene

#29

1/19/2014 5:28 AM

Hi Matthias,

Have you already created the text files for IndexHelper by hand, or you're waiting for us? If you still need the files for Nasdaq-100, please create a support ticket. We'd like to keep this in private for business reasons.