weylin"The Big Game."
RoyKah - grafitti time :D
RoyKACTION wonders how those spammers considers people in nerd/geek channels and how they're used to ignoring spam
RoyKsuperb owl > superbowl
ik_zelfDoes it hurt to have indexes on all foreign key columns in the datasbase? Why aren't they all in place?
coltttgood morning..
finalbetaGood morning.
volterik_zelf: You can create all the indices you want. They come at a little cost and of course they consume space. The question is, whether they are ever used.
volterik_zelf: Got a query?
finalbetaI have a task that needs to run once a week on sunday. To make sure that it does, I'm feeding a zabbix trapper item. I need to check in zabbix that it runs once a week.
finalbetaat the moment I'm using something like nodata(8d)
finalbetaBut is there a better way to specifically check for a day in the week?
ik_zelfThanks volter, it is not a query that is causing trouble, I am trying to get zabbix running on cockroachDB and that rdbms currently demands an index on every foreign key column.
volterAh, OK, I wouldn't worry then.
coltttis it somehow possible to get the snmp-OID from the host-item?
coltttin an action?
AraigumiHello, I have a problem with a zabbix agent check I have created: it is becoming "not supported" very often, and suddenly becomes "supported". Now I've put triggers, it is sending emails that the item is in a problem state but immediately sends an email to say it is OK ; I do not see the problem in the problem histoiry so I think this is a bug ; is anyone aware of that behaviour?
zabbixHello Araigumi, and welcome to #zabbix. I'm your friendly house bot :) Please be patient when it takes a while for people to reply. See our channel guidelines on https://zabbix.org/wiki/Getting_help#IRC and have a nice stay!
_NiCAraigumi, is this a userparameter?
Araigumiyes!
_NiCAraigumi, if you try zabbix_get on it, does it always return what you expect? Does the command sometimes take too long to run perhaps (reaches a timeout)?
AraigumiLet me try it and I tell you
kvosI have a question about ZBX-11700, I've got 2 calculated items. 1 is working fine, but the other gives me macro "{#XXXXXXX}" value is not numeric. Both are LLD items. Item that is working fine - Name:{#CPUNAME} Mem Pool percent free; formula:100*last("cempMemPoolFree.[{#CPUNAME}]") / ( last("cempMemPoolFree.[{#CPUNAME}]") + last("cempMemPoolUsed.[{#CPUNAME}]") ). The one that gives me the error on the discovery
kvos - Name: Free % memory on Memory Pool [{#MEMPOOLNAME}]; Formula:100*last("ciscoMemoryPoolFree.[{#MEMPOOLNAME}]") / (last("ciscoMemoryPoolFree.[{#MEMPOOLNAME}]" + last("ciscoMemoryPoolUsed.[{#MEMPOOLNAME}]")).
kvosError is "Cannot create item: macro "{#MEMPOOLNAME}" value is not numeric."
kvos#CPUNAME = name of routing processor in a cisco, modular. It gives me an output like "RSP 1/0" OR "RP 0/2
kvos#MEMPOOLNAME = Name over the memory pool on a cisco, that is on chassis basis. That gives me output like "Processor", "Reserved", "Image"
kvosI dont know what is going wrong here. And in older setups (zabbix 2.0) it was working fine. Im now on 3.4.4
kvos@Araigumi, make sure that the outcome of a userparameter always give's you something. like a count which can give you "null". convert that to "0".
Araigumi@_NiC I confirm it is working correctly (sry for delay, had to check how to use zabbix_get with PSK encryption - could that be a problem?). It is really only throwing trigger random, usually one to two times a day
kvosIs that on certain times?
Araigumi@kvos I'll check if it can be that sometimes the script is not returning any value
AraigumiIt's not always the same times, it looks random
kvosA time out at the execution of the script can also be happening
JimBurns83i've managed to get the zabbix 3.4 agent compiled using nmake on windows with tls support. I would like extend the agent, however I believe the modules api is not present for windows. has anyone else extended zabbix agent for windows? ideally I would like to use a wildcard key to point to an external command line application. eg UserParameter=module-*[*], c:\cli.exe $1 $2
NorNorHey all, what're the rumors on 4.0's release date?
JimBurns83lol really??? i remember waiting for 3.0 and then waiting for ubuntu 16.04. can't believe i'm almost in a position to go to production and it's been another year.
_ikke_We just upgraded to 3.4
JimBurns83I plan on going to production with 3.4. Once i've got on top of updating actions and templates via the API, I will be able to roll out new code releases via ansible and keep up with the new functions.
zabbixbot[04ZBX-13434] 03Incorrect trigger dependencies are set by copying triggers to multiple hosts 14created by Kotaro Miyashita14/kmiyashita (12https://support.zabbix.com/browse/ZBX-13434)
zabbixZBX-13434 Open Updated today -- Incorrect trigger dependencies are set by copying triggers to multiple hosts
tuxicki don't understand the logic/meaning of "cannot send list of active checks" in zabbix_server.log
tuxickhm
tuxickconfusing it with another confusing message :)
_ikke_tuxick: the first message means that the agent requests things to monitor but the server does not know about that agent
tuxick_ikke_: but it's in server log
tuxickuhm
tuxickthink i understand, lessee
_ikke_right, the server does not know what to send to the agent
_ikke_it means that there is no host in zabbix with the name of the agent
_ikke_(or it has been disabled)
troffaskyyeah, badly worded
_ikke_It says what's wrong, but not why
troffaskyi wouldn't even credit it with that!
troffasky"cannot send" suggests that it would like to send but is being prevented
tuxickyeah
troffasky"nothing to send" would be more accurate
tuxickvisible name vs host name
tuxickmaybe "agent not allowed to send" or something?
finalbetaDoes zabbix support macro's on maps? (in in what cases? ) {{HOST.NAME}.regsub((?:.*?_){3}(.*)(_),\1)}
finalbetaEhm, regex*
tuxickurgh
_ikke_regsub is only supported in limited cases
finalbetaMy systems have special hostsnames ,like _locationID_hostname_Identifier, but I would like to just show the hostname on some maps. So too bad :)
_ikke_Can you use visible name?
finalbetaI don't use visible name anywhere at the moment.
tuxickunder discovery rules i tried deleting this silly/default "custom intervals" but it just remains
tuxicksame for individual item prototypes btw
_ikke_Isn't that just a default new item that gets ignored when it's not filled?
tuxickit is filled in
tuxickresulting in those white/grey sections in graphs
_ikke_Aren't those 'working hours'?
tuxickye
tuxickmaybe it's a more global setting somewhere
tuxickright
tuxicki suppose i can simply blank that setting?
tuxickbut still, don't see why i can't disable it in a template
_ikke_Why do you think it's even active?
tuxicki see it in the graphs
kodeinedoes anyone know a way of displaying a trendline on a graph for the displayed items ?
kodeinei'd like to see a "trend" to see if the average measurement of the item is declining or increasing over a specific time
kodeineor maybe based on some prediction
tuxickkodeine: you might like grafana for that
kodeinetuxick: I have Grafana running, but I'm running all of my reporting on the native zabbix graphs for now, if there's a way I would prefer doing it in Zabbix, unless it's impossible ofcourse
tuxickkodeine: afaik it's supposed to be possible but no idea how :)
DmitryVhello, everyone! I can't create item prototype with key just plain "{#ITEM}", only something like "metric[{#ITEM}]". it's a bug or a feature?
zabbixHello DmitryV, and welcome to #zabbix. I'm your friendly house bot :) Please be patient when it takes a while for people to reply. See our channel guidelines on https://zabbix.org/wiki/Getting_help#IRC and have a nice stay!
tuxick\o/ got server log totally quiet
_NiCDmitryV, Sounds like a feature
DmitryVI'll report it then. Thank you!
_NiCreport a feature?
_ikke_tuxick: what parT?
tuxickmost noise from that cannot send active list thing
_ikke_ah ok
tuxicknow just the incidental slow query
zabbixbot[04ZBX-13435] 03Can't create item prototype with {#MACRO} as key 14created by Dmitry Verkhoturov14/Paskal (12https://support.zabbix.com/browse/ZBX-13435)
zabbixZBX-13435 Open Updated today -- Can't create item prototype with {#MACRO} as key
DmitryVsomeone, please fix formatting of original comment in https://support.zabbix.com/browse/ZBX-13435
zabbixZBX-13435 Open Updated today -- Can't create item prototype with {#MACRO} as key
DmitryVJIRA formatting is crap;(
tuxickACTION coughs
nkucan i get a list of psk identities a proxy known about? really can't figure out why it rejects some
nkuknows
_NiCIf I have "UserParameter=vfs.fs.mounted[*],findmnt -nr -o source -T $1 -O $2 > /dev/null && echo 0 || echo 1", and want to have $2 set to a default, if it is not supplied in the item, how do I do that?
_NiCIt sortof looks like it isn't possible.
_NiCCan I supply a comma separated list as a single argument to a userparameter?
Uzzihttps://share.zabbix.com/printers/universal-printer-template --->Item "Device serial number" on "Template SNMP Printer": application "General" does not exist.
UzziWhy?
_NiCLooks like "arg1,arg2" should work
_NiCUzzi, while importing?
Uzziyes
_NiCI guess the template defines items in that application, but doesn't actually created the application itself. Should be easy to add it to the template xml.
Richlv_NiC, bash -c "... ${2:-default}..."
Richlvah, wait, no
Richlvthing=$2 bash -c "... ${thing:-default}..."
nkunever mind, figured it out. hosts were misconfigured
RichlvDmitryV, https://www.zabbix.com/documentation/3.0/manual/appendix/macros/supported_by_location#macros_used_in_low-level_discovery
Richlv"for item prototypes in... key parameters"
_NiCRichlv, ah yeah. I know about that bash thing, didn't occur to me that I could use it in the userparameter command
_NiCRichlv, seems a bit complex for this though, and it's more of a nice-to-have. I documented that it wasn't optional, that's gotta be good enough :-)
kallenpHi. please where to change date/time format from rrrr-mm-dd TO dd-mm-rrrr ? My Zabbix version is 3.2
_NiCwhy would you want to changed date format *from* the glorious iso 8601? It's the best format.
_NiC(assuming r = y)
kallenpmy customer ask me to change
kallenpis it possible ?
_NiCI don't know :(
kvosI have a question about ZBX-11700, I've got 2 calculated items. 1 is working fine, but the other gives me macro "{#XXXXXXX}" value is not numeric. Both are LLD items. Item that is working fine - Name:{#CPUNAME} Mem Pool percent free; formula:100*last("cempMemPoolFree.[{#CPUNAME}]") / ( last("cempMemPoolFree.[{#CPUNAME}]") + last("cempMemPoolUsed.[{#CPUNAME}]") ). The one that gives me the error on the discovery
kvos - Name: Free % memory on Memory Pool [{#MEMPOOLNAME}]; Formula:100*last("ciscoMemoryPoolFree.[{#MEMPOOLNAME}]") / (last("ciscoMemoryPoolFree.[{#MEMPOOLNAME}]" + last("ciscoMemoryPoolUsed.[{#MEMPOOLNAME}]")).
kvosError is "Cannot create item: macro "{#MEMPOOLNAME}" value is not numeric."
kvos#CPUNAME = name of routing processor in a cisco, modular. It gives me an output like "RSP 1/0" OR "RP 0/2
kvos#MEMPOOLNAME = Name over the memory pool on a cisco, that is on chassis basis. That gives me output like "Processor", "Reserved", "Image"
kvosI dont know what is going wrong here. And in older setups (zabbix 2.0) it was working fine. Im now on 3.4.4
_NiCkvos, I heard you the first time.
kallenpany idea howto change the default date/time format ?
_ikke_Not sure if that's possible without changing the front-end code
_ikke_and note that the server even has a different format
_ikke_(for alerts)
_NiCkallenp, maybe it uses the system locale
_NiCso you can try changing that
_NiCor maybe it's a php(.ini) setting
kvos_NiC, sorry for that. Only i didn't get any response at all.
_ikke_depends if they provided a format string or not
_NiCkvos, I don't mind people asking again, but when it's a wall of text, it feels a bit spammy.
_ikke_If they use date(), then it's not possible, if they use strftime, it uses the system locale
Richlvkallenp, you can hack the zabbix locale
kvos_NiC, just trying to be complete in the question, instead of you have to ask for al the info
Richlvbut there are several places to do so
Richlv"for item prototypes in... key parameters"i'd try convincing the customer not to do so
Richlvkvos, hmm, maybe zabbix kinda extracts the number from there, but support for non-numeric lld thingies was removed
kvosIt's a part of the LLD key, zabbix dont have to do anything with it.
kallenpRichlv: OK, and thanks
kallenpHowto allow members of User Group to set host to maintenance mode ? But disable edit templates or any other R/W access ?
kallenpWhat's the best way ?
kvosRichlv, It's a macro that is the output of a LLD. And i would like to calculate the % of 2 items that are discovered.
kvoskallenp. The user must be zabbix-admin
kvoskallenp, but the user must have rw acces on the group
tuxickACTION spanks the housekeeper
_NiCthis feels like a #metoo situation
_NiCluckily we're in #zabbix
_NiC;)
tuxickyeah otherwise i'd be demanding french maid uniform
tuxickfirst network error, wait for 5 seconds
tuxickanother mystery in life
tuxicki set Timeout=14
tuxickooh i see
zabbixbot[04ZBX-13436] 03Teste 14created by Francisco Antonio Pereira Matos14/Francisco Matos (12https://support.zabbix.com/browse/ZBX-13436)
zabbixZBX-13436 Open Updated today -- Teste
Richlvkvos, ah, i see. weird. sure it's not some older error ?
kvosRichlv, I've found it! I'm using a User macro for the discovery also. I've changed it to #SNMPVALUE. know it's working fine
Electron^-hello guys, I'm creating a new server from scratch on centos 7 with zabbix 3.4.6 and postgres 9.5, i've set it up and after few hourrs of work it was working, but today, I restarted the VM on which I'm testing it and if I try to load the webpage I've an error: "Database error" "Error connecting to database"
zabbixHello Electron^-, and welcome to #zabbix. I'm your friendly house bot :) Please be patient when it takes a while for people to reply. See our channel guidelines on https://zabbix.org/wiki/Getting_help#IRC and have a nice stay!
Electron^-but i've checked the credential on /usr/share/zabbix/conf/zabbix.conf.php and everything is good
Electron^-in the logs I don't have anything
heajeElectron^-: Assuming your using Apache httpd, make sure you look at the error logs for it
kvosElectron, DB running?
heaje*your=you're
Electron^-@kvos, yep, I can connect via "psql -Uzabbix zabbix"
kvosthat's good :)
kvosSelinux running?
Electron^-kvos, yep
kvosTry what heaje says
Electron^-I'm using nginx, and I've checked the error log but there's nothing in there
heajeElectron^-: Try temporarily setting SELinux to permissive mode
heajeACTION REALLY hates SELinux
Electron^-that fixes but I don't want to disable it :)
Electron^-ACTION I love and hate it
heajeunderstood, but now you know what your problem is
heajeFigure out what SELinux policy you need to tweak
Electron^-ok thanks
Electron^-try to create custom rules
Electron^-thanks guys
tuxickgreat fun!
kvosRichlv, So the calculated items are working fine, IF I'm using #SNMPVALUE on the discovery rule. When I'm using a User macro, with a more tweaked LLD than it broke
RoyKheaje: setenforce permissive ;)
heajealways the right policy to tweak :)
_ikke_hehe :D
Richlvkvos, hmm, didn't fully get that. what exactly did you change ?
Richlvregarding selinux, it's somewhat discussed in https://support.zabbix.com/browse/ZBX-10542
iskorptixhello
zabbixHello iskorptix, and welcome to #zabbix. I'm your friendly house bot :) Please be patient when it takes a while for people to reply. See our channel guidelines on https://zabbix.org/wiki/Getting_help#IRC and have a nice stay!
iskorptixI've got such item
iskorptixlog.count[/var/log/rabbitmq/rabbit@mq1-sasl.log,(sup_sup|brutal_kill|x55)]
iskorptixfor some reason it counts every single line, even if the does not have sup_sup, brutal_kill or x55 pattern inside it
iskorptixcan someone please tell me what is wrong here ?
zabbixbot[04ZBX-13437] 03typo in the log item page 14created by richlv (12https://support.zabbix.com/browse/ZBX-13437)
zabbixZBX-13437 Open Updated today -- typo in the log item page
Richlviskorptix, more detil will be needed on what oyou did and what happened
Richlvyou.
Richlvbut bedtime for me
greg-sesteroHey all, last week I chatted about the out of control events table in my 3.4.6 environment. We have over 2.2 billion rows thanks to source=3. We should have future growth curtailed and have housekeeping set to keep just 1 day's worth of internal data.
greg-sesteroHowever, getting our table under control is proving to be problematic. Housekeeping can't handle it and runs nonstop. Does anyone have any experience on deleting data directly from the events table with a "delete from events where source=3" query? Are there connections to other tables that need to be considered?
voltergreg-sestero: Once you vacuum-full the table, it will be a lot smaller on disk and the housekeeper will probably cut it.
volterForeign keys should take care of that.
iskorptixRichlv: its ok, I've sorted it myself, thank you for your response anyway
iskorptixgn
greg-sesteroOkay--so once we blow away all the rows with source=3 (which will probably take a day or so with our luck), the next time housekeeper runs it'll do cleanup and other tasks on the orphaned data? Hopefully at least... :)
_ikke_greg-sestero: We face the same issue (though no real issues atm)
_ikke_greg-sestero: We at one point just had a script running removing all events older then a certain daite
_ikke_date
greg-sestero_ikke_: so just using mysql to delete all items with source=x shouldn't cause us any headaches? At least not more than we're already going through?
voltergreg-sestero: It's probably cheaper to select the relevant records into a new table and swap it out.
Araigumi@kvos && @_NiC you were right, the script was sometimes crashing! Thanks for your help
volterThis may require extra work, if foreign keys come into play.
greg-sesteroOne of the desperation ideas we had was just dropping the table completely, but that seemed frightening
Araigumianother question: how can I populate the "info" tab of the problems' dashboard? Or the tags? Basically I want to display for example an owner of the machine so that the operator knows who is concerned and can call the person directly
_ikke_greg-sestero: except from the performance impact, no
greg-sesteroOkay, thanks _ikke_ that's good to know. We're in a broken state now, so performance impact isn't much of a concern for once
greg-sesterovolter: Re-reading one of your messages and wasn't sure what "vacuum-full the table" meant until I did some reading. So the process would be delete where source=3, vacuum full the table to clean, and then re-enable housekeeper?
voltergreg-sestero: What DBMS are you using?
greg-sesterovolter:mysql
volterIn general, you set one-table-per-file, right?
greg-sesteroYessir
volterI _believe_ that this is the equivalent to vacuum-full: https://dev.mysql.com/doc/refman/5.7/en/optimize-table.html
volterHowever, if Zabbix is not running, it could really be vastly cheaper to recover the few records you want in a replacement table and swap it in.
volterI don't have the schema at hand. Mind posting the schema of the events table on a paste site?
greg-sesteroOkay--I'll do some research and see what I can figure out. Zabbix is running, we're just unstable and having issues with CPU/IO when housekeeping and syncer processes get going. It's hard to tell what is at play: the upgrade, the potential bugs in 3.4.6, or the size of events.
greg-sesteroMy gut says the events table size has to be culled regardless and would make the other issues worse, no matter what. But that might not be our silver bullet.
_ikke_greg-sestero: How big is the DB, and what kind of hardware do you have?
greg-sesteroAnd I'd be happy to post the schema, though I don't know how to be honest. Let me do some reading
_ikke_greg-sestero: 'describe <tablename>'
_ikke_or show create table <tablename> to get the actual definition
_ikke_greg-sestero: To be honest, even when our DB ran on a san, we never had big performance issues due to housekeeper (it just could not keep up)
greg-sesteroWe're running on a dedicated ESX cluster for our environment. Single zabbix-server with local db, console, nine proxies. The DB is about 4T
_ikke_We're keeping our DB smaller on purpose
greg-sesteroVolter: Here's a paste of the schema. https://pastebin.com/Fssw8JBR
volterThat doesn't contain the foreign keys, or are there none?
volterhttp://zabbix.org/wiki/Troubleshooting#Help.2C_my_history_uint_table_is_300_GB_and_2.2_billion_records_big.21_.28PostgreSQL.29 -- That's remotely related.
greg-sesterovolter: That's pretty uncanny, it's almost exactly the size and number of rows in our db.
greg-sesteroGood find, thanks for the link
volterI wrote that, easy to find for me.
volterYes, I noticed the same.
greg-sesteroWell thanks for writing that :)
greg-sesteroThank you guys for all the help, I'm going to go do some more reading tonight and will get back at it in the morning. Lots to digest for sure.
volterYou are welcome!
zabbixI am Batman!
volterShut up