Page MenuHomeWildfire Games

irishninja (Brian Broll)
User

Projects

User does not belong to any projects.

User Details

User Since
Aug 4 2019, 2:04 AM (18 w, 1 d)

Recent Activity

Thu, Dec 5

irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.

Updated python dependencies and fixed bug when built w/o the RL interface.

Thu, Dec 5, 10:45 PM

Tue, Nov 12

nani awarded D2199: Add RPC interface for Reinforcement Learning a Like token.
Tue, Nov 12, 4:21 AM
irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.

Updated installation/testing instructions in README for the python client and removed the user option for the RL interface address as it must be set on start and may be confusing for users.

Tue, Nov 12, 4:06 AM
irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.

Added tests for actions and configuring scenarios. I also removed the extra example since it didn't contain anything new as compared to the better one ;)

Tue, Nov 12, 3:42 AM

Mon, Nov 11

irishninja added inline comments to D2199: Add RPC interface for Reinforcement Learning.
Mon, Nov 11, 3:27 PM
irishninja added a comment to D2199: Add RPC interface for Reinforcement Learning.

As an update, I am currently working on adding tests for the actions and scenario config (using pytest). I have tests for all the actions in zero_ad/actions.py and a number of the different scenario settings. I am currently working on testing random map usage. After finishing the tests, I am planning on training a simple agent as an example demonstrating how it can be used to expose an OpenAI Gym API to 0 AD :) (I will probably do this in an external repo and then just post a link to it.)

Mon, Nov 11, 3:24 PM

Oct 24 2019

irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.

Miscellaneous code cleanup per Stan's feedback.

Oct 24 2019, 12:38 AM

Oct 23 2019

irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.

Updates:

  • Define ScenarioConfig in Python. Added basic helpers for defining victory conditions as well as more generic setters (set_map_setting, set_game_setting).
  • Refactored RL Server main loop to own method
  • Changed default build to not include RL interface (uses --with-rlinterface)
Oct 23 2019, 1:46 AM

Sep 14 2019

irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.

Added more actions (construct, gather, train, attack-walk) and an example script showing a lot of these basic actions.

Sep 14 2019, 12:29 AM

Aug 24 2019

irishninja added inline comments to D2199: Add RPC interface for Reinforcement Learning.
Aug 24 2019, 6:20 AM

Aug 23 2019

irishninja updated the diff for D2199: Add RPC interface for Reinforcement Learning.
  • Added --without-rlinterface compile flag
  • Removed generated files
  • Added config option for the rpc server address (both to the default.cfg and to the options.json used in-game)
Aug 23 2019, 10:34 PM

Aug 22 2019

irishninja awarded D2197: Add support for recording replay metadata when in nonvisual mode a Like token.
Aug 22 2019, 9:29 PM
irishninja updated the diff for D2197: Add support for recording replay metadata when in nonvisual mode.

Cleaned up the updates to the SaveReplayMetadata function (mentioned in the prior reviews). I also made the argument for the fn const since it is read-only.

Aug 22 2019, 7:51 AM
irishninja added a comment to D2197: Add support for recording replay metadata when in nonvisual mode.

I will be updating the diff with the most recent fixes. Dumb question: when I update the diff, does it add the changes to the existing diff or overwrite it with the most recent diff? I usually use git and GitHub and am still getting used to Phabricator...

Aug 22 2019, 7:49 AM

Aug 21 2019

elexis awarded D2197: Add support for recording replay metadata when in nonvisual mode a Like token.
Aug 21 2019, 10:06 PM
irishninja updated the diff for D2197: Add support for recording replay metadata when in nonvisual mode.

Updates:

  • Removed duplicate functions for getReplayMetadata to more directly call the fn from the GuiInterface.
    • Updated VisualReplay::SaveReplayMetadata to call GuiInterface directly from the C++. After the code change, I removed the (now unused) ScriptInterface argument from the method signature.
    • Replaced the single invocation of getReplayMetadata with Engine.GuiInterfaceCall("GetReplayMetadata")
  • Added the registration of GetInitAttributes which should have been included in the original diff.
  • Added myself to the credits
Aug 21 2019, 9:55 PM
irishninja added a comment to D2197: Add support for recording replay metadata when in nonvisual mode.

Thanks for the feedback! I added some responses inline and will be updating the diff (hopefully addressing all the remaining issues)!

Aug 21 2019, 9:45 PM
irishninja added a comment to D2199: Add RPC interface for Reinforcement Learning.

As @Stan said, there is more discussion on the PR on GitHub. The goal of this contribution is to provide the fundamental underlying capabilities for exploring RL/ML agents in 0 AD (such as an OpenAI gym environment which can actually be implemented on top of this quite easily). I am intentionally not adding any action/observation spaces or reward as expected by OpenAI gym as these are not obvious and there are many different candidates for each of these (this is discussed more on the GitHub thread).

Aug 21 2019, 7:04 PM
irishninja added a comment to D2199: Add RPC interface for Reinforcement Learning.

Thanks for the feedback! I can move it to be behind a feature flag and remove the generated files.

Aug 21 2019, 12:00 AM

Aug 20 2019

irishninja updated the diff for D2197: Add support for recording replay metadata when in nonvisual mode.

Changed NULL to nullptr

Aug 20 2019, 10:41 PM
irishninja updated the diff for D2197: Add support for recording replay metadata when in nonvisual mode.

I added GetReplayMetadata to the GuiInterface component to reduce code duplication introduced by the original diff.

Aug 20 2019, 10:38 PM
irishninja added a comment to D2197: Add support for recording replay metadata when in nonvisual mode.

Thanks for the feedback - I have added my responses inline!

Aug 20 2019, 6:52 PM
Stan awarded D2199: Add RPC interface for Reinforcement Learning a Love token.
Aug 20 2019, 7:21 AM
irishninja created D2199: Add RPC interface for Reinforcement Learning.
Aug 20 2019, 2:46 AM
irishninja created D2197: Add support for recording replay metadata when in nonvisual mode.
Aug 20 2019, 2:15 AM