Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NameError when installing plugins #2674

Closed
joekiller opened this issue Feb 24, 2015 · 23 comments
Closed

NameError when installing plugins #2674

joekiller opened this issue Feb 24, 2015 · 23 comments

Comments

@joekiller
Copy link
Contributor

I'm trying to install any plugin and getting the following error

$ /opt/logstash/bin/plugin install /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem --debug
Validating /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem
Error reading plugin file /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem, caused by NameError
Installation aborted

I get the Error reading plugin file ... caused by NameError for any plugin I try to install. Tips?

@joekiller
Copy link
Contributor Author

ran with debug:

sudo DEBUG=true /opt/logstash/bin/plugin install /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem
Validating /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem
Error reading plugin file /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem, caused by NameError
uninitialized constant Gem::Package

@joekiller
Copy link
Contributor Author

Might have to do with 9e7d620

@joekiller
Copy link
Contributor Author

Actually it might have to do with the lack of that commit. Seems like that isn't in 1.5 yet. Trying master...

@joekiller
Copy link
Contributor Author

Same problem on master.

@purbon
Copy link
Contributor

purbon commented Feb 24, 2015

Facing this same problem with master, Gem::Package goes away if you require 'rubygems\package' but then the plugin is not found somehow. (debugging as we speak)

@joekiller
Copy link
Contributor Author

Cool. I finally just tried the beta from http://www.elasticsearch.org/overview/logstash/download/ and that is working so I'm going to continue my plugin development from there for now.

@purbon
Copy link
Contributor

purbon commented Feb 24, 2015

/cc @ph @colinsurprenant @jsvd

@purbon purbon added this to the v1.5.0 rc1 milestone Feb 24, 2015
@ph
Copy link
Contributor

ph commented Feb 24, 2015

@joekiller What you can do is to add this line to your Gemfile:

gem 'mynewplugin', :path => '~/path/to/the-plugin'

@purbon purbon removed their assignment Feb 24, 2015
@ph
Copy link
Contributor

ph commented Feb 24, 2015

Oups too fast on the enter key.

After adding the line you will need to do run this command

bin/plugin install --no-verify

@ph
Copy link
Contributor

ph commented Feb 24, 2015

@joekiller note that you only need to run the command once to make logstash add your plugin to his loading paths.

@colinsurprenant
Copy link
Contributor

@joekiller, what @ph said.
The support for local .gem files in the pluginmanager is not completed, we decided to postpone it a bit but in development mode you can manually add it in the Gemfile as explained by @ph.

I also encourage you to use current master instead of beta1 in http://www.elasticsearch.org/overview/logstash/download/ - we are approaching RC1 and, frankly, any issue you can report will help us iron it out!

@joekiller
Copy link
Contributor Author

I'll try the .gem file update next.

Just to confirm as y'all suspect, if I install the latest beta from the download page, I get The error reported is: \n kafka must set a milestone. which has to do with all the commits that remove milestones in the plugins, ie logstash-plugins/logstash-input-kafka@aa8098c

If I run bin/plugin install --no-verify with 1.5 or master (which is 2.0) I get the error about local gems not being there:

$ DEBUG=true bin/plugin install --no-verify /tmp/logstash-input-kafka-0.1.9.gem
Installing /tmp/logstash-input-kafka-0.1.9.gem
Plugin not found, aborting
HTTP GET https://bundler.rubygems.org/api/v1/dependencies
HTTP 200 OK
Fetching gem metadata from https://rubygems.org/
Query List: ["rspec", "logstash-devutils", "ci_reporter", "simplecov", "coveralls", "logstash-output-zeromq", "logstash-codec-collectd", "logstash-output-xmpp", "logstash-codec-dots", "logstash-codec-edn", "logstash-codec-edn_lines", "logstash-codec-fluent", "logstash-codec-es_bulk", "logstash-codec-graphite", "logstash-codec-json", "logstash-codec-json_lines", "logstash-codec-line", "logstash-codec-msgpack", "logstash-codec-multiline", "logstash-codec-netflow", "logstash-codec-oldlogstashjson", "logstash-codec-plain", "logstash-codec-rubydebug", "logstash-filter-anonymize", "logstash-filter-checksum", "logstash-filter-clone", "logstash-filter-csv", "logstash-filter-date", "logstash-filter-dns", "logstash-filter-drop", "logstash-filter-fingerprint", "logstash-filter-geoip", "logstash-filter-grok", "logstash-filter-json", "logstash-filter-kv", "logstash-filter-metrics", "logstash-filter-multiline", "logstash-filter-mutate", "logstash-filter-ruby", "logstash-filter-sleep", "logstash-filter-split", "logstash-filter-syslog_pri", "logstash-filter-throttle", "logstash-filter-urldecode", "logstash-filter-useragent", "logstash-filter-uuid", "logstash-filter-xml", "logstash-input-couchdb_changes", "logstash-input-elasticsearch", "logstash-input-eventlog", "logstash-input-exec", "logstash-input-file", "logstash-input-ganglia", "logstash-input-gelf", "logstash-input-generator", "logstash-input-graphite", "logstash-input-imap", "logstash-input-irc", "logstash-input-kafka", "logstash-input-log4j", "logstash-input-lumberjack", "logstash-input-pipe", "logstash-input-rabbitmq", "logstash-input-redis", "logstash-input-s3", "logstash-input-snmptrap", "logstash-input-sqs", "logstash-input-stdin", "logstash-input-syslog", "logstash-input-tcp", "logstash-input-twitter", "logstash-input-udp", "logstash-input-unix", "logstash-input-xmpp", "logstash-input-zeromq", "logstash-output-cloudwatch", "logstash-output-csv", "logstash-output-elasticsearch", "logstash-output-email", "logstash-output-exec", "logstash-output-file", "logstash-output-ganglia", "logstash-output-gelf", "logstash-output-graphite", "logstash-output-hipchat", "logstash-output-http", "logstash-output-irc", "logstash-output-juggernaut", "logstash-output-kafka", "logstash-output-lumberjack", "logstash-output-nagios", "logstash-output-nagios_nsca", "logstash-output-null", "logstash-output-opentsdb", "logstash-output-pagerduty", "logstash-output-pipe", "logstash-output-rabbitmq", "logstash-output-redis", "logstash-output-s3", "logstash-output-sns", "logstash-output-sqs", "logstash-output-statsd", "logstash-output-stdout", "logstash-output-tcp", "logstash-output-udp", "/tmp/logstash-input-kafka-0.1.9.gem", "cabin", "pry", "stud", "clamp", "filesize", "treetop", "i18n", "ftw", "mime-types", "rack", "sinatra", "jar-dependencies", "ruby-maven", "maven-tools", "minitar", "file-dependencies", "jruby-httpclient", "jrjackson"]
Query Gemcutter Dependency Endpoint API: rspec,logstash-devutils,ci_reporter,simplecov,coveralls,logstash-output-zeromq,logstash-codec-collectd,logstash-output-xmpp,logstash-codec-dots,logstash-codec-edn,logstash-codec-edn_lines,logstash-codec-fluent,logstash-codec-es_bulk,logstash-codec-graphite,logstash-codec-json,logstash-codec-json_lines,logstash-codec-line,logstash-codec-msgpack,logstash-codec-multiline,logstash-codec-netflow,logstash-codec-oldlogstashjson,logstash-codec-plain,logstash-codec-rubydebug,logstash-filter-anonymize,logstash-filter-checksum,logstash-filter-clone,logstash-filter-csv,logstash-filter-date,logstash-filter-dns,logstash-filter-drop,logstash-filter-fingerprint,logstash-filter-geoip,logstash-filter-grok,logstash-filter-json,logstash-filter-kv,logstash-filter-metrics,logstash-filter-multiline,logstash-filter-mutate,logstash-filter-ruby,logstash-filter-sleep,logstash-filter-split,logstash-filter-syslog_pri,logstash-filter-throttle,logstash-filter-urldecode,logstash-filter-useragent,logstash-filter-uuid,logstash-filter-xml,logstash-input-couchdb_changes,logstash-input-elasticsearch,logstash-input-eventlog,logstash-input-exec,logstash-input-file,logstash-input-ganglia,logstash-input-gelf,logstash-input-generator,logstash-input-graphite,logstash-input-imap,logstash-input-irc,logstash-input-kafka,logstash-input-log4j,logstash-input-lumberjack,logstash-input-pipe,logstash-input-rabbitmq,logstash-input-redis,logstash-input-s3,logstash-input-snmptrap,logstash-input-sqs,logstash-input-stdin,logstash-input-syslog,logstash-input-tcp,logstash-input-twitter,logstash-input-udp,logstash-input-unix,logstash-input-xmpp,logstash-input-zeromq,logstash-output-cloudwatch,logstash-output-csv,logstash-output-elasticsearch,logstash-output-email,logstash-output-exec,logstash-output-file,logstash-output-ganglia,logstash-output-gelf,logstash-output-graphite,logstash-output-hipchat,logstash-output-http,logstash-output-irc,logstash-output-juggernaut,logstash-output-kafka,logstash-output-lumberjack,logstash-output-nagios,logstash-output-nagios_nsca,logstash-output-null,logstash-output-opentsdb,logstash-output-pagerduty,logstash-output-pipe,logstash-output-rabbitmq,logstash-output-redis,logstash-output-s3,logstash-output-sns,logstash-output-sqs,logstash-output-statsd,logstash-output-stdout,logstash-output-tcp,logstash-output-udp,/tmp/logstash-input-kafka-0.1.9.gem,cabin,pry,stud,clamp,filesize,treetop,i18n,ftw,mime-types,rack,sinatra,jar-dependencies,ruby-maven,maven-tools,minitar,file-dependencies,jruby-httpclient,jrjackson
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=rspec,logstash-devutils,ci_reporter,simplecov,coveralls,logstash-output-zeromq,logstash-codec-collectd,logstash-output-xmpp,logstash-codec-dots,logstash-codec-edn,logstash-codec-edn_lines,logstash-codec-fluent,logstash-codec-es_bulk,logstash-codec-graphite,logstash-codec-json,logstash-codec-json_lines,logstash-codec-line,logstash-codec-msgpack,logstash-codec-multiline,logstash-codec-netflow,logstash-codec-oldlogstashjson,logstash-codec-plain,logstash-codec-rubydebug,logstash-filter-anonymize,logstash-filter-checksum,logstash-filter-clone,logstash-filter-csv,logstash-filter-date,logstash-filter-dns,logstash-filter-drop,logstash-filter-fingerprint,logstash-filter-geoip,logstash-filter-grok,logstash-filter-json,logstash-filter-kv,logstash-filter-metrics,logstash-filter-multiline,logstash-filter-mutate,logstash-filter-ruby,logstash-filter-sleep,logstash-filter-split,logstash-filter-syslog_pri,logstash-filter-throttle,logstash-filter-urldecode,logstash-filter-useragent,logstash-filter-uuid,logstash-filter-xml,logstash-input-couchdb_changes,logstash-input-elasticsearch,logstash-input-eventlog
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash-input-exec,logstash-input-file,logstash-input-ganglia,logstash-input-gelf,logstash-input-generator,logstash-input-graphite,logstash-input-imap,logstash-input-irc,logstash-input-kafka,logstash-input-log4j,logstash-input-lumberjack,logstash-input-pipe,logstash-input-rabbitmq,logstash-input-redis,logstash-input-s3,logstash-input-snmptrap,logstash-input-sqs,logstash-input-stdin,logstash-input-syslog,logstash-input-tcp,logstash-input-twitter,logstash-input-udp,logstash-input-unix,logstash-input-xmpp,logstash-input-zeromq,logstash-output-cloudwatch,logstash-output-csv,logstash-output-elasticsearch,logstash-output-email,logstash-output-exec,logstash-output-file,logstash-output-ganglia,logstash-output-gelf,logstash-output-graphite,logstash-output-hipchat,logstash-output-http,logstash-output-irc,logstash-output-juggernaut,logstash-output-kafka,logstash-output-lumberjack,logstash-output-nagios,logstash-output-nagios_nsca,logstash-output-null,logstash-output-opentsdb,logstash-output-pagerduty,logstash-output-pipe,logstash-output-rabbitmq,logstash-output-redis,logstash-output-s3,logstash-output-sns
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash-output-sqs,logstash-output-statsd,logstash-output-stdout,logstash-output-tcp,logstash-output-udp,/tmp/logstash-input-kafka-0.1.9.gem,cabin,pry,stud,clamp,filesize,treetop,i18n,ftw,mime-types,rack,sinatra,jar-dependencies,ruby-maven,maven-tools,minitar,file-dependencies,jruby-httpclient,jrjackson
HTTP 200 OK
Query List: ["docile", "simplecov-html", "multi_json", "lockfile", "builder", "rspec-mocks", "rspec-expectations", "rspec-core", "cucumber", "hoe", "diff-lcs", "syntax", "spicycode-rcov", "thor", "term-ansicolor", "rest-client", "colorize", "json", "xml-simple", "nokogiri", "logstash", "logstash-patterns-core", "edn", "murmurhash3", "jruby-openssl", "geoip", "metriks", "user_agent_parser", "elasticsearch", "awesome_print", "jls-grok", "bindata", "jruby-win32ole", "xmpp4r", "ffi-rzmq", "msgpack-jruby", "msgpack", "insist", "gem_publisher", "rake", "filewatch", "addressable", "manticore", "concurrent-ruby", "redis", "mail", "cinch", "march_hare", "bunny", "jls-lumberjack", "aws-sdk", "snmp", "logstash-mixin-aws", "gelf", "gelfd", "jruby-kafka", "thread_safe", "gmetric", "rufus-scheduler", "twitter", "ruby-maven-libs", "archive-tar-minitar", "rcov", "win32console", "method_source", "slop", "coderay", "spoon", "ruby_parser", "yard", "tilt", "mongrel", "shotgun", "rack-test", "rack-protection", "backports", "test-spec", "camping", "fcgi", "memcache-client", "ruby-openid", "thin", "http_parser.rb", "minitest", "facets", "polyglot", "virtus", "ffi", "statsd-ruby"]
Query Gemcutter Dependency Endpoint API: docile,simplecov-html,multi_json,lockfile,builder,rspec-mocks,rspec-expectations,rspec-core,cucumber,hoe,diff-lcs,syntax,spicycode-rcov,thor,term-ansicolor,rest-client,colorize,json,xml-simple,nokogiri,logstash,logstash-patterns-core,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,elasticsearch,awesome_print,jls-grok,bindata,jruby-win32ole,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,insist,gem_publisher,rake,filewatch,addressable,manticore,concurrent-ruby,redis,mail,cinch,march_hare,bunny,jls-lumberjack,aws-sdk,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,thread_safe,gmetric,rufus-scheduler,twitter,ruby-maven-libs,archive-tar-minitar,rcov,win32console,method_source,slop,coderay,spoon,ruby_parser,yard,tilt,mongrel,shotgun,rack-test,rack-protection,backports,test-spec,camping,fcgi,memcache-client,ruby-openid,thin,http_parser.rb,minitest,facets,polyglot,virtus,ffi,statsd-ruby
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=docile,simplecov-html,multi_json,lockfile,builder,rspec-mocks,rspec-expectations,rspec-core,cucumber,hoe,diff-lcs,syntax,spicycode-rcov,thor,term-ansicolor,rest-client,colorize,json,xml-simple,nokogiri,logstash,logstash-patterns-core,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,elasticsearch,awesome_print,jls-grok,bindata,jruby-win32ole,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,insist,gem_publisher,rake,filewatch,addressable,manticore,concurrent-ruby,redis,mail,cinch,march_hare,bunny,jls-lumberjack
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=aws-sdk,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,thread_safe,gmetric,rufus-scheduler,twitter,ruby-maven-libs,archive-tar-minitar,rcov,win32console,method_source,slop,coderay,spoon,ruby_parser,yard,tilt,mongrel,shotgun,rack-test,rack-protection,backports,test-spec,camping,fcgi,memcache-client,ruby-openid,thin,http_parser.rb,minitest,facets,polyglot,virtus,ffi,statsd-ruby
HTTP 200 OK
Query List: ["elasticsearch-api", "elasticsearch-transport", "ffi-rzmq-core", "rspec-support", "activesupport", "tlsmail", "eventmachine", "multi_test", "gherkin", "cucumber-core", "json_pure", "launchy", "tins", "RubyInline", "rubyforge", "gemcutter", "amq-protocol", "netrc", "rdoc", "mini_portile", "racc", "tenderlove-frex", "rake-compiler", "rexical", "weakling", "bouncy-castle-java", "avl_tree", "hitimes", "atomic", "rbtree", "faraday", "faraday_middleware", "yajl-ruby", "parslet", "ref", "functional-ruby", "logstash", "aws-sdk-resources", "aws-sdk-v1", "uuidtools", "httparty", "daemons", "fastthread", "gem_plugin", "cgi_multipart_eof_fix", "axiom-types", "coercible", "equalizer", "descendants_tracker", "ruby-yadis", "ZenTest", "flexmock", "mocha", "erubis", "activerecord", "markaby", "metaid", "mab", "sexp_processor", "ParseTree", "escape_utils", "eventmachine-le", "preforker", "bones", "tzinfo", "simple_oauth", "naught", "memoizable", "http", "buftok", "jbundler"]
Query Gemcutter Dependency Endpoint API: elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,rspec-support,activesupport,tlsmail,eventmachine,multi_test,gherkin,cucumber-core,json_pure,launchy,tins,RubyInline,rubyforge,gemcutter,amq-protocol,netrc,rdoc,mini_portile,racc,tenderlove-frex,rake-compiler,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,atomic,rbtree,faraday,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,descendants_tracker,ruby-yadis,ZenTest,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,sexp_processor,ParseTree,escape_utils,eventmachine-le,preforker,bones,tzinfo,simple_oauth,naught,memoizable,http,buftok,jbundler
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,rspec-support,activesupport,tlsmail,eventmachine,multi_test,gherkin,cucumber-core,json_pure,launchy,tins,RubyInline,rubyforge,gemcutter,amq-protocol,netrc,rdoc,mini_portile,racc,tenderlove-frex,rake-compiler,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,atomic,rbtree,faraday,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,descendants_tracker,ruby-yadis
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=ZenTest,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,sexp_processor,ParseTree,escape_utils,eventmachine-le,preforker,bones,tzinfo,simple_oauth,naught,memoizable,http,buftok,jbundler
HTTP 200 OK
Query List: ["blankslate", "multi_xml", "crack", "echoe", "jnunemaker-crack", "hashie", "oauth2", "roauth", "multipart-post", "configuration", "spruz", "net-scp", "trollop", "mkrf", "adamantium", "ice_nine", "aws-sdk-core", "SexpProcessor", "metaclass", "form_data", "certified", "abstract", "little-plugger", "loquacious", "bones-git", "bones-extras", "bundler", "arel", "activemodel", "activerecord-deprecated_finders"]
Query Gemcutter Dependency Endpoint API: blankslate,multi_xml,crack,echoe,jnunemaker-crack,hashie,oauth2,roauth,multipart-post,configuration,spruz,net-scp,trollop,mkrf,adamantium,ice_nine,aws-sdk-core,SexpProcessor,metaclass,form_data,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,bundler,arel,activemodel,activerecord-deprecated_finders
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=blankslate,multi_xml,crack,echoe,jnunemaker-crack,hashie,oauth2,roauth,multipart-post,configuration,spruz,net-scp,trollop,mkrf,adamantium,ice_nine,aws-sdk-core,SexpProcessor,metaclass,form_data,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,bundler,arel,activemodel,activerecord-deprecated_finders
HTTP 200 OK
Query List: ["net-ssh", "git", "safe_yaml", "highline", "allison", "bones-rcov", "bones-rubyforge", "bones-rspec", "bones-zentest", "curses", "bcrypt-ruby", "httpauth", "jwt", "faraday-middleware", "jmespath", "jamespath"]
Query Gemcutter Dependency Endpoint API: net-ssh,git,safe_yaml,highline,allison,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,bcrypt-ruby,httpauth,jwt,faraday-middleware,jmespath,jamespath
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=net-ssh,git,safe_yaml,highline,allison,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,bcrypt-ruby,httpauth,jwt,faraday-middleware,jmespath,jamespath
HTTP 200 OK
Query List: ["termios", "bcrypt", "needle", "jruby-pageant", "psych"]
Query Gemcutter Dependency Endpoint API: termios,bcrypt,needle,jruby-pageant,psych
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=termios,bcrypt,needle,jruby-pageant,psych
HTTP 200 OK
Query List: []
Fetching version metadata from https://rubygems.org/
Query List: ["bones", "rubyforge", "ZenTest", "termios", "rspec", "rcov", "json", "multi_json", "bcrypt", "needle", "jruby-pageant", "echoe", "psych", "net-ssh", "sexp_processor", "git", "safe_yaml", "activesupport", "rake", "highline", "gemcutter", "allison", "rdoc", "hoe", "bones-rcov", "bones-rubyforge", "bones-rspec", "bones-zentest", "curses", "builder", "i18n", "bcrypt-ruby", "faraday", "httpauth", "rack", "jwt", "faraday-middleware", "multi_xml", "backports", "ice_nine", "thread_safe", "memoizable", "jmespath", "jamespath", "blankslate", "crack", "jnunemaker-crack", "hashie", "oauth2", "roauth", "multipart-post", "addressable", "spoon", "configuration", "ffi", "minitest", "spruz", "launchy", "json_pure", "net-scp", "trollop", "term-ansicolor", "mkrf", "rake-compiler", "tzinfo", "memcache-client", "atomic", "adamantium", "descendants_tracker", "gherkin", "nokogiri", "aws-sdk-core", "RubyInline", "SexpProcessor", "metaclass", "form_data", "http_parser.rb", "certified", "abstract", "little-plugger", "loquacious", "bones-git", "bones-extras", "jar-dependencies", "bundler", "ruby-maven", "maven-tools", "thor", "arel", "activemodel", "activerecord-deprecated_finders", "elasticsearch-api", "elasticsearch-transport", "ffi-rzmq-core", "diff-lcs", "rspec-support", "rspec-core", "rspec-expectations", "mime-types", "tlsmail", "treetop", "cabin", "eventmachine", "multi_test", "cucumber-core", "polyglot", "tins", "simplecov", "amq-protocol", "netrc", "mini_portile", "racc", "tenderlove-frex", "rexical", "weakling", "bouncy-castle-java", "avl_tree", "hitimes", "rbtree", "faraday_middleware", "yajl-ruby", "parslet", "ref", "functional-ruby", "logstash", "aws-sdk-resources", "aws-sdk-v1", "uuidtools", "httparty", "ruby_parser", "daemons", "fastthread", "gem_plugin", "cgi_multipart_eof_fix", "axiom-types", "coercible", "equalizer", "ruby-yadis", "flexmock", "mocha", "erubis", "activerecord", "markaby", "metaid", "mab", "ParseTree", "escape_utils", "eventmachine-le", "preforker", "simple_oauth", "naught", "http", "buftok", "jbundler", "aws-sdk", "logstash-codec-plain", "docile", "simplecov-html", "lockfile", "rspec-mocks", "cucumber", "syntax", "spicycode-rcov", "rest-client", "colorize", "xml-simple", "logstash-filter-grok", "logstash-patterns-core", "logstash-codec-line", "edn", "murmurhash3", "jruby-openssl", "geoip", "metriks", "user_agent_parser", "logstash-codec-json", "elasticsearch", "ftw", "awesome_print", "jls-grok", "bindata", "jruby-win32ole", "logstash-output-null", "logstash-input-generator", "xmpp4r", "ffi-rzmq", "msgpack-jruby", "msgpack", "logstash-filter-date", "logstash-filter-mutate", "insist", "minitar", "gem_publisher", "filewatch", "manticore", "stud", "concurrent-ruby", "logstash-codec-json_lines", "redis", "mail", "cinch", "logstash-input-tcp", "march_hare", "bunny", "jls-lumberjack", "snmp", "logstash-mixin-aws", "gelf", "gelfd", "jruby-kafka", "gmetric", "rufus-scheduler", "twitter", "logstash-filter-json", "logstash-output-file", "ruby-maven-libs", "archive-tar-minitar", "win32console", "method_source", "slop", "coderay", "yard", "tilt", "mongrel", "shotgun", "rack-test", "rack-protection", "test-spec", "camping", "fcgi", "ruby-openid", "thin", "facets", "virtus", "statsd-ruby"]
Query Gemcutter Dependency Endpoint API: bones,rubyforge,ZenTest,termios,rspec,rcov,json,multi_json,bcrypt,needle,jruby-pageant,echoe,psych,net-ssh,sexp_processor,git,safe_yaml,activesupport,rake,highline,gemcutter,allison,rdoc,hoe,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,builder,i18n,bcrypt-ruby,faraday,httpauth,rack,jwt,faraday-middleware,multi_xml,backports,ice_nine,thread_safe,memoizable,jmespath,jamespath,blankslate,crack,jnunemaker-crack,hashie,oauth2,roauth,multipart-post,addressable,spoon,configuration,ffi,minitest,spruz,launchy,json_pure,net-scp,trollop,term-ansicolor,mkrf,rake-compiler,tzinfo,memcache-client,atomic,adamantium,descendants_tracker,gherkin,nokogiri,aws-sdk-core,RubyInline,SexpProcessor,metaclass,form_data,http_parser.rb,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,jar-dependencies,bundler,ruby-maven,maven-tools,thor,arel,activemodel,activerecord-deprecated_finders,elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,diff-lcs,rspec-support,rspec-core,rspec-expectations,mime-types,tlsmail,treetop,cabin,eventmachine,multi_test,cucumber-core,polyglot,tins,simplecov,amq-protocol,netrc,mini_portile,racc,tenderlove-frex,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,rbtree,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,ruby_parser,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,ruby-yadis,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,ParseTree,escape_utils,eventmachine-le,preforker,simple_oauth,naught,http,buftok,jbundler,aws-sdk,logstash-codec-plain,docile,simplecov-html,lockfile,rspec-mocks,cucumber,syntax,spicycode-rcov,rest-client,colorize,xml-simple,logstash-filter-grok,logstash-patterns-core,logstash-codec-line,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,logstash-codec-json,elasticsearch,ftw,awesome_print,jls-grok,bindata,jruby-win32ole,logstash-output-null,logstash-input-generator,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,logstash-filter-date,logstash-filter-mutate,insist,minitar,gem_publisher,filewatch,manticore,stud,concurrent-ruby,logstash-codec-json_lines,redis,mail,cinch,logstash-input-tcp,march_hare,bunny,jls-lumberjack,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,gmetric,rufus-scheduler,twitter,logstash-filter-json,logstash-output-file,ruby-maven-libs,archive-tar-minitar,win32console,method_source,slop,coderay,yard,tilt,mongrel,shotgun,rack-test,rack-protection,test-spec,camping,fcgi,ruby-openid,thin,facets,virtus,statsd-ruby
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=bones,rubyforge,ZenTest,termios,rspec,rcov,json,multi_json,bcrypt,needle,jruby-pageant,echoe,psych,net-ssh,sexp_processor,git,safe_yaml,activesupport,rake,highline,gemcutter,allison,rdoc,hoe,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,builder,i18n,bcrypt-ruby,faraday,httpauth,rack,jwt,faraday-middleware,multi_xml,backports,ice_nine,thread_safe,memoizable,jmespath,jamespath,blankslate,crack,jnunemaker-crack,hashie,oauth2,roauth
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=multipart-post,addressable,spoon,configuration,ffi,minitest,spruz,launchy,json_pure,net-scp,trollop,term-ansicolor,mkrf,rake-compiler,tzinfo,memcache-client,atomic,adamantium,descendants_tracker,gherkin,nokogiri,aws-sdk-core,RubyInline,SexpProcessor,metaclass,form_data,http_parser.rb,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,jar-dependencies,bundler,ruby-maven,maven-tools,thor,arel,activemodel,activerecord-deprecated_finders,elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,diff-lcs,rspec-support,rspec-core,rspec-expectations,mime-types,tlsmail
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=treetop,cabin,eventmachine,multi_test,cucumber-core,polyglot,tins,simplecov,amq-protocol,netrc,mini_portile,racc,tenderlove-frex,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,rbtree,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,ruby_parser,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,ruby-yadis,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,ParseTree,escape_utils,eventmachine-le,preforker,simple_oauth
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=naught,http,buftok,jbundler,aws-sdk,logstash-codec-plain,docile,simplecov-html,lockfile,rspec-mocks,cucumber,syntax,spicycode-rcov,rest-client,colorize,xml-simple,logstash-filter-grok,logstash-patterns-core,logstash-codec-line,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,logstash-codec-json,elasticsearch,ftw,awesome_print,jls-grok,bindata,jruby-win32ole,logstash-output-null,logstash-input-generator,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,logstash-filter-date,logstash-filter-mutate,insist,minitar,gem_publisher,filewatch,manticore,stud,concurrent-ruby,logstash-codec-json_lines,redis,mail
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=cinch,logstash-input-tcp,march_hare,bunny,jls-lumberjack,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,gmetric,rufus-scheduler,twitter,logstash-filter-json,logstash-output-file,ruby-maven-libs,archive-tar-minitar,win32console,method_source,slop,coderay,yard,tilt,mongrel,shotgun,rack-test,rack-protection,test-spec,camping,fcgi,ruby-openid,thin,facets,virtus,statsd-ruby
HTTP 200 OK
Query List: ["faraday-middleware", "logstash"]
Query Gemcutter Dependency Endpoint API: faraday-middleware,logstash
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=faraday-middleware,logstash
HTTP 200 OK
Query List: []
Fetching dependency metadata from https://rubygems.org/
Query List: ["faraday-middleware", "logstash"]
Query Gemcutter Dependency Endpoint API: faraday-middleware,logstash
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=faraday-middleware,logstash
HTTP 200 OK
Query List: []
Resolving dependencies...
Error: Bundler::GemNotFound, Could not find gem '/tmp/logstash-input-kafka-0.1.9.gem (>= 0) java' in the gems available on this machine.
Installation aborted

@colinsurprenant
Copy link
Contributor

@joekiller you cannot install a local .gem file with in the current master/1.5 branch using bin/plugin install --no-verify ~/path/to/the-plugin/mynewplugin.gem

you have to add it manually in the Gemfile :

gem 'mynewplugin', :path => '~/path/to/the-plugin'

and execute:

bin/plugin install --no-verify

@colinsurprenant
Copy link
Contributor

@joekiller arggghh sorry, you cannot specify a path to a .gem file in Gemfile, only a path to a local gem DIRECTORY.

so, do not build your gem, simply point :path to the directory containing your gem development and this will work.

@joekiller
Copy link
Contributor Author

@colinsurprenant yup I got it to install with the non-built gem directory as you said. I then hit

Bundler::GemfileNotFound: Could not locate Gemfile or .bundle/ directory
                         root at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:198
                  bundle_path at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:101
  configure_gem_home_and_path at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:420
                    configure at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:92
                   definition at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:153
                        setup at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:118
               bundler_setup! at /opt/logstash/lib/logstash/environment.rb:100
                       (root) at /opt/logstash/lib/logstash/runner.rb:8

Interestingly enough, if I run the process via the logstash user, it works so it might be a startup script issue at this point. Still digging...

@colinsurprenant
Copy link
Contributor

@joekiller are you running directly from master or are you generating a .rpm/.deb ? we are actually at the point of testing the .rpm/.deb artifacts. we know the .tar.gz is good but there is likely some issues with the OS packages.

@joekiller
Copy link
Contributor Author

Running out of /opt/logstash after installing the rpm

@joekiller
Copy link
Contributor Author

So I get the GemfileNotFound error if I'm not in /opt/logstash when I run the bin/logstash -f /path/to/configs runs fine when I launch within the directory. Diffing the debug output of the scripts yields no difference. Diggin more :)

@joekiller
Copy link
Contributor Author

lol, just saw #2671 come through on master and that might fix this second part. Testing...

@joekiller
Copy link
Contributor Author

Nope. Opening another issue for the GemfileNotFound. I have narrowed it down.

@ph
Copy link
Contributor

ph commented Feb 24, 2015

@joekiller Can you check if you have a .bundle/config in your logstash directory? Can you try to delete it and retry?

@joekiller
Copy link
Contributor Author

Yeah everything works if I delete .bundle/config #2681 gives the details of the bug otherwise.

@suyograo
Copy link
Contributor

Closing this in lieu of #2681

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants