Can't see fields on Kibana after parsing log.

Hi,
I was trying to use regexp to parse my logs to extract some of the fields, and I cannot see them on Kibana. I'm using fluentd container to achieve this. But there's no indication from docker logs to know what's wrong.
Here's my fluentd.conf:
<source>
        @type tail
        path /newfluentd/logs/asd.log
        pos_file /newfluentd/logs/asd.log.pos
        tag spk.aeroapp
        read_from_head true
        <parse>
                @type regexp
                expression /^(?<logtime>[a-zA-Z]* \d* \d* \d*:\d*:\d*) GMT\D\d*: INFO \(info\): \(ticker.c:\d*\) {(?<namespace>\w*)} client: tsvc \((?<client_tsvc_error>\d*),(?<client_tsvc_timeout>\d*)\) proxy \((?<client_proxy_complete>\d*),(?<client_proxy_error>\d*),(?<client_proxy_timeout>\d*)\) read \((?<client_read_success>\d*),(?<client_read_error>\d*),(?<client_read_timeout>\d*),(?<client_read_not_found>\d*)\) write \((?<client_write_success>\d*),(?<client_write_error>\d*),(?<client_write_timeout>\d*)\) delete \((?<client_delete_success>\d*),(?<client_delete_error>\d*),(?<client_delete_timeout>\d*),(?<client_delete_not_found>\d*)\) udf \((?<client_udf_complete>\d*),(?<client_udf_error>\d*),(?<client_udf_timeout>\d*)\) lang \((?<client_lang_read_success>\d*),(?<client_lang_write_success>\d*),(?<client_lang_delete_success>\d*),(?<client_lang_error>\d*)\)
                time_key logtime
                time_format %b %d %Y %H:%M:%S
        </parse>
</source>

<match spk.**>
        @type elasticsearch
        host <IP_ADDRESS>
        port 9200
        index_name fluentd_asp
        flush_interval 10s
</match>

Here's my application log line (/newfluentd/logs/asd.log):
Oct 13 2018 23:59:53 GMT+0800: INFO (info): (ticker.c:585) {starhub_kvs} client: tsvc (0,0) proxy (0,0,0) read<PHONE_NUMBER>,0,0,2110808) write (345776441,5944686,0) delete (0,0,0,0) udf (0,0,0) lang (0,0,0,0)

Here's my container logs:
2018-11-10 16:41:00 +0000 [info]: parsing config file is succeeded path="/fluentd/etc/fluent.conf"
2018-11-10 16:41:00 +0000 [info]: using configuration file: <ROOT>
  <source>
    @type tail
    path "/newfluentd/logs/asd.log"
    pos_file "/newfluentd/logs/asd.log.pos"
    tag "spk.aeroapp"
    read_from_head true
    <parse>
      @type "regexp"
      expression /^(?<logtime>[a-zA-Z]* \d* \d* \d*:\d*:\d*) GMT\D\d*: INFO \(info\): \(ticker.c:\d*\) {(?<namespace>\w*)} client: tsvc \((?<client_tsvc_error>\d*),(?<client_tsvc_timeout>\d*)\) proxy \((?<client_proxy_complete>\d*),(?<client_proxy_error>\d*),(?<client_proxy_timeout>\d*)\) read \((?<client_read_success>\d*),(?<client_read_error>\d*),(?<client_read_timeout>\d*),(?<client_read_not_found>\d*)\) write \((?<client_write_success>\d*),(?<client_write_error>\d*),(?<client_write_timeout>\d*)\) delete \((?<client_delete_success>\d*),(?<client_delete_error>\d*),(?<client_delete_timeout>\d*),(?<client_delete_not_found>\d*)\) udf \((?<client_udf_complete>\d*),(?<client_udf_error>\d*),(?<client_udf_timeout>\d*)\) lang \((?<client_lang_read_success>\d*),(?<client_lang_write_success>\d*),(?<client_lang_delete_success>\d*),(?<client_lang_error>\d*)\)
      time_key "logtime"
      time_format "%b %d %Y %H:%M:%S"
    </parse>
  </source>
  <match spk.**>
    @type elasticsearch
    host "<IP_ADDRESS>"
    port 9200
    index_name "fluentd_asp"
    flush_interval 10s
    <buffer tag>
      flush_mode interval
      retry_type exponential_backoff
      flush_interval 10s
    </buffer>
  </match>
</ROOT>
2018-11-10 16:41:00 +0000 [info]: starting fluentd-1.2.6 pid=7 ruby="2.3.3"
2018-11-10 16:41:00 +0000 [info]: spawn command to main:  cmdline=["/usr/bin/ruby2.3", "-Eascii-8bit:ascii-8bit", "/usr/local/bin/fluentd", "-c", "/fluentd/etc/fluent.conf", "-p", "/fluentd/plugins", "--under-supervisor"]
2018-11-10 16:41:00 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '1.9.5'
2018-11-10 16:41:00 +0000 [info]: gem 'fluentd' version '1.2.6'
2018-11-10 16:41:00 +0000 [info]: adding match pattern="spk.**" type="elasticsearch"
2018-11-10 16:41:00 +0000 [info]: adding source type="tail"

Can you help in debugging this.
Thanks

Missing slash at the end of the expression parameter.
Please follow the guideline.

Thanks. got that.
Can you also help with the following:
Suppose my logs have multiple lines like this:
Stopped XYZ
Started GET "/users/123/" for <IP_ADDRESS> at 2013-06-14 12:00:11 +0900
Processing by UsersController#show as HTML
Done Processing ID-254

I need to write regex (in fluent.conf) to parse only the 2nd and 3rd lines and ignore all the other lines:
I did something like this, but it doesn't seem to work. What's the best way.
<parse>
@type regexp
expression /^Started (?<method>[^ ]+) "(?<path>[^"]+)" for (?<host>[^ ]+) at (?<time>[^ ]+ [^ ]+ [^ ]+)/
expression /^Processing by (?<controller>[^\u0023]+)\u0023(?<controller_method>[^ ]+) as (?<format>[^ ]+?)/
</parse>

The logs print pattern not match for the other two lines and I cannot see any data on Elasticsearch.
Thanks in advance.

Use the combo with grep Filter Plugin and fluent-plugin-concat
BTW, don't use fluentd repo for asking question.
You can ask your question to the mailing list.


Unable to create XML according to the selected groups

Hi, I have been using the python script and it looks really nice, thanks for your work.
anyway. there;s an issue on it that is unable to properly sort the xml when it comes by groups, at least is what i have test it so far.
here;s the error
2Traceback (most recent call last):   File "./m3u-epg-editor.py", line 434, in <module>     main()   File "./m3u-epg-editor.py", line 100, in main     xml_tree = create_new_epg(args, epg_filename, m3u_entries)   File "./m3u-epg-editor.py", line 375, in create_new_epg     output_str("creating channel element for {}".format(channel_id))   File "./m3u-epg-editor.py", line 160, in output_str     print("%s %s" % (datetime.datetime.now().isoformat(), event_str)) IOError: [Errno 0] Error
my line goes something like this with Vaders
C:\Python27\python.exe ./m3u-epg-editor.py -m="http://api.vaders.tv/vget?username=username&password=password&format=ts" -e="http://vaders.tv/.xml.gz" -g="'sports','latino','spain','ireland','united kingdom','united states'" -d="C:\Users\Carlos\Documents\Plex-Scripts\m3u_epg_optimizer\m3u-epg-editor" -f="test"
Hope this help you to help US :)
Thanks

I've had no luck reproducing the problem that you're seeing here yet. However one thing I do notice is that you're a windows user and in your command line, you've specified the path to the python script like this:
C:\Python27\python.exe ./m3u-epg-editor.py
..and I'm not sure this is correct for windows because ./ at the start of m3u-epg-editor.py basically means: use the current folder in linux. Please try something like this instead to see if it helps:
C:\Python27\python.exe "C:\the\full\path\to\m3u-epg-editor.py"

Another thing that I noticed in your command line is that this doesn't look like the correct url to the vaderstreams epg file: http://vaders.tv/.xml.gz

@jjssoftware Thanks for getting back to me - regarding the line
C:\Python27\python.exe ./m3u-epg-editor.py is correct if i'm located in the same folder of m3u-epg-editor.
So to be more exact i do this
C:\Python27\python.exe C:\Users\Carlos\Documents\tools\m3u-epg-editor\m3u-epg-editor.py -m="http://api.vaders.tv/vget?username=usr&password=pssw&format=ts" --epgurl="http://vaders.tv/p2.xml.gz" -g="'sports'" --outdirectory="C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests" -f="C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests\Sports_unsorted"
This will create some files

Sports_unsorted.m3u
original.channels.txt
original.m3u
Sports_unsorted.channles.txt
original.gz
original.xml

But then will fail to create sports_unsorted.xml
here are the full output details
C:\Python27\python.exe C:\Users\Carlos\Documents\tools\m3u-epg-editor\m3u-epg-editor.py -m="http://api.vaders.tv/vget?username=2047car&password=54a8ssd&format=ts" --epgurl="http://vaders.tv/p2.xml.gz" -g="'sports'" --outdirectory="C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests" -f="C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests\Sports_unsorted" 2018-03-06T11:17:16.773000 performing HTTP GET request to http://api.vaders.tv/vget?username=usr&password=pssw&format=ts 2018-03-06T11:17:17.355000 saving retrieved m3u file: C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests\original.m3u8 2018-03-06T11:17:17.375000 parsing m3u into a list of objects 2018-03-06T11:17:17.428000 m3u contains 2157 items 2018-03-06T11:17:17.429000 keeping channel groups in this set(['sports']) 2018-03-06T11:17:17.455000 filtered m3u contains 213 items 2018-03-06T11:17:17.457000 saving new m3u file: C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests\Sports_unsorted.m3u8 2018-03-06T11:17:17.471000 performing HTTP GET request to http://vaders.tv/p2.xml.gz 2018-03-06T11:17:17.582000 saving retrieved epg file: C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests\original.gz 2018-03-06T11:17:20.609000 extracting retrieved epg file to: C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests\original.xml 2018-03-06T11:17:21.619000 creating new xml epg for 213 m3u items 2018-03-06T11:17:23.309000 creating channel element for PTVSoprts.pk 2018-03-06T11:17:23.314000 creating channel element for beINSports11.qa 2018-03-06T11:17:23.314000 creating channel element for beINSports12.qa 2018-03-06T11:17:23.319000 creating channel element for SonySix.in 2018-03-06T11:17:23.319000 creating channel element for NeoSports.in 2018-03-06T11:17:23.326000 creating channel element for Ten1.in 2018-03-06T11:17:23.333000 creating channel element for EirSport1.ie 2018-03-06T11:17:23.335000 creating channel element for SkySportsNews.uk 2018-03-06T11:17:23.335000 creating channel element for AtTheRaces.uk 2018-03-06T11:17:23.337000 creating channel element for Eurosport1.uk 2018-03-06T11:17:23.339000 creating channel element for Eurosport2.uk 2018-03-06T11:17:23.342000 creating channel element for MUTV.uk 2018-03-06T11:17:23.345000 creating channel element for BTSport1.uk 2018-03-06T11:17:23.351000 creating channel element for BTSport2.uk 2018-03-06T11:17:23.356000 creating channel element for BTSport3.uk 2018-03-06T11:17:23.359000 creating channel element for BTSportESPN.uk 2018-03-06T11:17:23.362000 creating channel element for ChelseaTV.uk 2018-03-06T11:17:23.364000 creating channel element for LiverpoolFCTV.uk 2018-03-06T11:17:23.366000 creating channel element for MotorsTV.uk 2018-03-06T11:17:23.368000 creating channel element for PremierSports.uk 2018-03-06T11:17:23.370000 creating channel element for RacingUK.uk 2018-03-06T11:17:23.373000 creating channel element for SkySportsF1.uk 2018-03-06T11:17:23.376000 creating channel element for SkySportsMainEvent.uk 2018-03-06T11:17:23.378000 creating channel element for SkySportsPremiereLeague.uk 2Traceback (most recent call last):   File "C:\Users\Carlos\Documents\tools\m3u-epg-editor\m3u-epg-editor.py", line 434, in <module>     main()   File "C:\Users\Carlos\Documents\tools\m3u-epg-editor\m3u-epg-editor.py", line 100, in main     xml_tree = create_new_epg(args, epg_filename, m3u_entries)   File "C:\Users\Carlos\Documents\tools\m3u-epg-editor\m3u-epg-editor.py", line 375, in create_new_epg     output_str("creating channel element for {}".format(channel_id))   File "C:\Users\Carlos\Documents\tools\m3u-epg-editor\m3u-epg-editor.py", line 160, in output_str     print("%s %s" % (datetime.datetime.now().isoformat(), event_str)) IOError: [Errno 0] Error PS C:\Users\Carlos\Documents\Plex-Scripts\development\telly\tests>
Hope this gives you a better look
Thanks Again,

Thank you for that but we're not there yet.
I can see the line of Python where it throws the exception / goes wrong but no test that I've performed so far has been able to reproduce this problem and nothing said so far has given any clues to what is causing this.
I do have Windows 7 running in a virtual machine, I'm running this in a regular powershell 5.1 window and it's working ok there. I've emulated / recreated your folder structure to rule out path length related issues as the cause.
Are you running Windows 10?  If you're in a powershell window, what does this return: $PSVersionTable
This is what mine returns:
Name                           Value
----                           -----
PSVersion                      5.1.14409.1005
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.14409.1005
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

Do you have any special regional or language settings configured in Windows?

If this is being run in powershell I suspect that this could be unicode / non-unicode related but before I start making changes and ask you test those candidate changes I'd appreciate it if you could answer the questions above. Please also add anything else you can think of that might be a bit non-standard about your setup.
If you are running this in powershell then I guess you could try running this in a regular command prompt (if possible?) to narrow this down to something in powershell as the cause.

OK getting closer now. Going on a hunch that you are running Windows 10 and also executing this script in a powershell window, I grabbed a copy of a Windows 10 virtual machine and I've now managed to reproduce this issue.
My steps to reproduce this are a little non-standard but it does reliably reproduce the problem exactly as you've described:

Start powershell
Execute the python script as outlined in your command line example in your comment
As the python script is executing, drag the mouse across the powershell window which causes the script to pause execution and then once paused, hit return to resume script execution

At step 3, I note that sometimes the script will immediately fail with IOError: [Errno 0] Error when it resumes on the first attempt but sometimes it can take 2 or more attempts to get it to fail in this way.
I have also been able to reproduce this problem following the same steps using a regular command prompt window instead of powershell.
I'm not sure if this is how you cause this problem to occur or if something else is triggering this for you.
The good news however is that it's now reliably reproducible here so I should be able to come up with a fix for this.

This appears to be a Windows 10 bug documented here, currently in the process of being fixed but is not yet released.
I'll try and come up with some way of elegantly handling this issue in the meantime so that it doesn't cause the python script to fail.

Please see the fix commit applied here: https://github.com/jjssoftware/m3u-epg-editor/pull/3/commits/9a801b49a573b5d80d5319d698b36cf26d0b8862
I've tested this in Windows 10 in both powershell and a regular command prompt and it has fixed this issue for how I was reproducing it. Please give this a test and let me know if it improves things for you.

@jjssoftware Thanks for your prompt reply on this bug and also my apologies for the delay to reply (Really busy this days at work)... btw you might think of a discord chat will be more straight forward for replies :)/
I will give it a try and let you know.

No problem @haxcop there's no rush, thanks for testing it when you have time.
So far as discord / slack / other comms tools go, I have no interest in this sort of thing for my own github projects. I'm sure that issue comments are good enough for the stuff that I work on in here; there's just no need for anything more real-time / engaging.

HI @jjssoftware the problem remains when it comes to sort the xml file

2018-03-10T15:57:10.584000 creating channel element for I121.100264.schedulesdirect.org
2018-03-10T15:57:10.586000 creating channel element for I401.49609.schedulesdirect.org
2Traceback (most recent call last):
File ".\m3u-epg-editor.py", line 382, in
main()
File ".\m3u-epg-editor.py", line 71, in main
xml_tree = create_new_epg(args, epg_filename, m3u_entries)
File ".\m3u-epg-editor.py", line 325, in create_new_epg
output_str("creating channel element for {}".format(channel_id))
File ".\m3u-epg-editor.py", line 131, in output_str
print("%s %s" % (datetime.datetime.now().isoformat(), event_str))
IOError: [Errno 0] Error
PS C:\Users\Carlos\Documents\Plex-Scripts\development\m3u-epg-editor>

So here's my enviroment details:

Win10
PS C:\WINDOWS\system32> $PSVersionTable

Name                           Value

PSVersion                      5.1.16299.248
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.16299.248
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

@jjssoftware Sorry - for some reasson is not working on my Powershell into vs code but i just tried on Native powershell window and didn't gave me any error.
Thanks!.

Yes this does sound very much like the Windows 10 bug that I linked to above. Lots of users are reporting issues with the vs code shell in that vs code issue
It sounds like you might have it working isolated in a powershell window rather than vs code however I must say that the line numbers that you've included in your last comment look off. I strongly suspect you're not running the right version which includes the fix that I asked you to test. If that's the case I'm not surprised you're still seeing this problem.

Can you confirm that you're testing the patched script or should I just go ahead and merge the candidate fix into the master branch?

@jjssoftware will do tomorrow thanks

@jjssoftware works as it should. very nice work thanks!.  go ahead and merge

Thanks for confirming @haxcop very much appreciated.
Pull request https://github.com/jjssoftware/m3u-epg-editor/pull/3 is merged.
Thanks for finding and reporting this. This issue is now closed. Feel free to open another if you have any more problems.


Accommodate chain loading, please.

I use BootAnim9 to display a boot animation before AuReiNand (Well, Luma3DS now) loads. As a result, my AuReiNand loader is arm9payload.bin. Could you please add support for those of us that chainload AuReiNand? I would love to use this auto-updater, but right now it would overwrite BootAnim9.

Not the Dev, but you should be able to set the payload path in the config (see the latest release) and it will automatically store the AuReiNand payload there and automatically patch it for that path.

Then it shouldn't even affect your BootAnim9 payload. Will just replace the (now) Luma3DS payload

I got linked to an old release rather than the current release, oops.
This is perfect now, thanks.


275

locations detail page redesign.
adds CHARMcare favorite badge, card design for main content, flexbox layout for sidebar (switches to bottom of screen on mobile), tons of aesthetic CSS
new files:
app/views/component/detail/_audience.html.haml
app/views/component/detail/_featured_location_badge.html.haml
app/views/component/detail/_location_transportation.html.haml
app/views/component/detail/_phones.html.haml
app/views/component/detail/_tags.html.haml

Can you post a screenshot of the design changes?


Add an implementation for cubeb_stream_get_input_latency

MacOS implementation for https://github.com/kinetiknz/cubeb/pull/583 (this can't build right now we need to merge and bump cubeb-rs).

LGTM! We should try to run the test after cubeb-rs is bumped!

I've now taken some time to test this by forcing paths in Cargo.toml. I have similar number with https://padenot.github.io/roundtrip-latency-tester/ and with this API (by summing input and output latency of course), so it works well.


Issue with k8s.io/docs/tutorials/kubernetes-basics/create-cluster/cluster-interactive/

Hi,
While doing interactive session with katakoda, the server is not showing the kubectl server version. it only shows client version. giving the below error.
Error:
kubectl version
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.3", GitCommit:"06ad960bfd03b39c8310aaf92d1e7c12ce618213", GitTreeState:"clean", BuildDate:"2020-02-11T18:14:22Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"linux/amd64"}
The connection to the server localhost:8080 was refused - did you specify the right host or port?
And also, the terminal gets hung for a long time.
kindly check

I tried to replicate, but, I was unable to. I got the below output
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.3", GitCommit:"06ad960bfd03b39c8310aaf92d1e7c12ce618213", GitTreeState:"clean", BuildDate:"2020-02-11T18:14:22Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.3", GitCommit:"06ad960bfd03b39c8310aaf92d1e7c12ce618213", GitTreeState:"clean", BuildDate:"2020-02-11T18:07:13Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"linux/amd64"}

It might be flakiness. Was this a constant error?

Thanks for the update. The issue resolved now. You can close the issue.
Thank you for your support.
Thanks,
Gayatri
On Sat, 10 Oct, 2020, 5:55 am Paul<EMAIL_ADDRESS>wrote:

I tried to replicate, but, I was unable to. I got the below output
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.3", GitCommit:"06ad960bfd03b39c8310aaf92d1e7c12ce618213", GitTreeState:"clean", BuildDate:"2020-02-11T18:14:22Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.3", GitCommit:"06ad960bfd03b39c8310aaf92d1e7c12ce618213", GitTreeState:"clean", BuildDate:"2020-02-11T18:07:13Z", GoVersion:"go1.13.6", Compiler:"gc", Platform:"linux/amd64"}
It might be flakiness. Was this a constant error?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes/website/issues/24454#issuecomment-706453801,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ARKB4OSHIC64JSA7YUHEMF3SJ6SYTANCNFSM4SKJMEGA
.

/close


[SR-7076] Make ContiguousArray Codable

Implements Encodable and Decodable for ContiguousArray.

Resolves SR-7076.

@xwu - Thank you for the feedback!

@xwu - Are you able to trigger the tests?

Sure, but this PR needs to have some tests first before that'd be meaningful, no?

@xwu - Yeah figured still made sense to run the smoke tests.  I look around a bit and couldn't find the spot where Codable was tests for Array and what not.  Happy to add a test to the appropriate spot if I can get some guidance as to where to put those / examples of similar ones.

@airspeedswift - Do we still want to move forward with this or shall I close?


Gatling fails at "Generating reports..."

I'm new to NATS and Gatling.
I'm evaluating NATS streaming in one of the project.
To evaluate performance, tried with nats-connector-gatling.
I added com.logimethods:nats-connector-gatling_2.11:0.3.0 dependency in maven project.
Simulation is completed, but reports are not generated.
It would be good if you can provide pointers to resolve this. I can provide sample project if required.
Here is the error log:
Simulation io.nats.NatsInjection completed in 59 seconds Parsing log file(s)... Parsing log file(s) done Generating reports... java.lang.reflect.InvocationTargetException         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)         at java.lang.reflect.Method.invoke(Method.java:498)         at io.gatling.mojo.MainWithArgsInFile.runMain(MainWithArgsInFile.java:50)         at io.gatling.mojo.MainWithArgsInFile.main(MainWithArgsInFile.java:33) Caused by: java.lang.UnsupportedOperationException: There were no requests sent during the simulation, reports won't be generated         at io.gatling.charts.report.ReportsGenerator.generateFor(ReportsGenerator.scala:48)         at io.gatling.app.LogFileProcessor.generateReports(RunResultProcessor.scala:64)         at io.gatling.app.LogFileProcessor.processRunResult(RunResultProcessor.scala:43)         at io.gatling.app.Gatling.start(Gatling.scala:66)         at io.gatling.app.Gatling$.start(Gatling.scala:57)         at io.gatling.app.Gatling$.fromArgs(Gatling.scala:49)         at io.gatling.app.Gatling$.main(Gatling.scala:43)         at io.gatling.app.Gatling.main(Gatling.scala)         ... 6 more

A sample project would definitely be helpful.
Regards.

Thanks for quick reply.
nats-gatling-proj.zip
I ran "mvn test" command to run simulation.

@happyviral, I can reproduce your issue.
Actually, the Gatling to Nats Connector was NOT developed to generate reports (a feature that makes sense when we are expecting a response like when calling a Web page), but "only" to generate large number of messages sent to NATS. That's why calling that reports feature fails.
If you want to monitor the number of messages generated, I would suggest having a look at the SmartMeter Project, which makes use of Graphite/Grafana. To do so, you should use a configuration that looks like gatling.conf.
Hope I did answer your question.


feature(big-prompt): allow multi-line input during chat mode

Multiple commits each their own change

@camAtGitHub Thank you very much for your contribution! Good stuff!
I had an issue with sed during testing, which is probably due to the differences between mac sed and linux/normal sed. When I used the multiline prompt, I got a sed: 1: ":a;N;$!ba;s/\r{0,1}\n/\ ...": unused label 'a;N;$!ba;s/\r{0,1}\n/\\n/g'. So I used the escape function that was recently added instead of sed.
Also you are right about renaming the OPENAI key variable, but we should do this also in the install script to not break for new installs and preferably have it in a separate .conf or .key file to isolate from the bash profile and secure it further. So this can be an issue of its own in the future.
Thank you for your work! Very neat! 🙏


Additional font example

Could some one give an example with additional fonts? I tried it and failed. It seems like PdfDict Object, Any one know it? Thanks a lot

Hi , I wish my work can help you.
I have figured out a solution of pdf.js annotation, use only pdf.js dist, and it is very easy to import into your project.
Demo and source code: https://demos.libertynlp.com/#/pdfjs-annotation
Demo video:https://www.youtube.com/watch?v=IYD7WKzx-yc&t=3s
functions:
① highlight : highlight selected text;
② underline : underline selected text;
③ edit: edit annotation ( copy/delete/add comment/navigate );
④ output annotations : output annotations for importing;
⑤ import annotations : import annotations for current file;
⑥ download annotations : download annotations and comments text;
⑦ undo annotations : undo annotations in current page;
⑧ help : open help file;


Fix environment setup and package installation via flake.nix

It is probably difficult to confirm, but "it works on my machine". Which, in the context of nix, means it should work on everybody else's as well.
Closes #57

Do you think it's worth the effort of e.g. spinning up a docker container or VM with Nix to see this work, e.g. demonstrated by you in person? Otherwise I think I'll just trust your word for it and approve this PR 🥲

Testing it on a different, fresh system sounds like a great idea. We can do that together.


Error filter with custom Exception class doesn't work

We have a custom exception class called ModelValidationException. For some reason the filter is not keeping the exception from being propagated via email and other forms of logging. The app does not crash while loading because it does seem to recognize the type. The filter does work properly with a regular type such as System.Exception.
<errorFilter>
      <test>
        <not>
          <is-type binding="Exception" type="MEDIC.Web.ModelValidationException, MEDIC.Web" />
        </not>
      </test>
</errorFilter>

When moving this filter into code (method #2 from http://www.diaryofaninja.com/blog/2011/09/20/adding-filters-to-your-elmah-installation), inside the Global.asax, it works fine.

I think you might have the condition inverted due to the <not>. Try with just:
<errorFilter>
    <test>
        <is-type binding="Exception" type="MEDIC.Web.ModelValidationException, MEDIC.Web" />
    </test>
</errorFilter>

Does it help?


Generic Textarea component

Description
Create a generic Textarea component to ensure consistent UI and behavior for form input elements across the pages.
Technical Details
The following components will be required:

FormTextarea: A generic input component that handles both active and disabled states with different logic.
HookFormTextarea: A wrapper around FormTextarea that integrates with react-hook-form using useFormContext for data binding.

Definition of Done (DOD)

Display all possible textarea variations on the example page at /examples/textareas.

@funtigr https://dev-pltsvc.apps.silver.devops.gov.bc.ca/examples/ui/textarea

Now we have the common component for text areas:


FR: Merging Android Dynamic Shortcuts

Some months ago I was following a discussion about the Android Dynamic Shortcuts integration into the official Wireguard android app
https://github.com/WireGuard/wireguard-android/pull/55
https://github.com/WireGuard/wireguard-android/pull/48
I think it would be a great feature since beyond the customization, these would also give for free the "trusted wifi" feature that even if works good to me (I am doing some futher testing on my phone about #15) some phones may just work better with the dyn shortcuts approach or some users would just prefer this or may have less battery impact.. in this way users would still get the extended features & support of this app compared to the official one

Thank you for the info on this. Does this replace the need for Quicktiles? I am currently working on a feature for Quicktiles but there seems to be a lot of overlap in these two features.

This is about app shortcuts. In Android an app can, besides the app itself, also present widgets and shortcuts to the system, which gets propagated to for example the launcher apps.
The shortcuts be used on your homescreen or by long pressing the app icon on your homescreen.
Additionally, other apps can use the app shortcuts as well.
It's a bit of an old Android feature. For example, music recognition apps like Shazam and the former TrackID apps, allowed for a shortcut to be placed on the homescreen. The advantage was that if you click that, instead of the app icon, recognition started directly.
Nowadays I think it's more commonly used when long pressing an app icon, a context menu is presented with the actions.

This is about app shortcuts. In Android an app can, besides the app itself, also present widgets and shortcuts to the system, which gets propagated to for example the launcher apps.
The shortcuts be used on your homescreen or by long pressing the app icon on your homescreen.
Additionally, other apps can use the app shortcuts as well.
It's a bit of an old Android feature. For example, music recognition apps like Shazam and the former TrackID apps, allowed for a shortcut to be placed on the homescreen. The advantage was that if you click that, instead of the app icon, recognition started directly.
Nowadays I think it's more commonly used when long pressing an app icon, a context menu is presented with the actions.

I think the most common use case would be Google routines, bixby etc integrations

I still don't see this feature in the version released In Play Store what's the matter with that?


Add gluon tutorial link on README.rst

Description
(Brief description on what this PR is about)
Checklist
Essentials

[x] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[x] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage
[x] Code is well-documented

Changes

[x] Feature1, tests, (and when applicable, API doc)
[x] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

Job PR-484/1 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-484/1/index.html

Please update PR title with category next time so that it's easier to prepare release notes.


Cache Linode API calls

Would be nice to introduce a cache layer in front of the Linode API client, to avoid unnecessary requests.

We don't need this at the moment, because we fixed a bug which caused high load on the Linode API.


Support request

Failing to authenticate using faas-cli to my digital ocean cluster.
Expected Behaviour

Install cloud functions on digital ocean.
Current Behaviour

Calling the OpenFaaS server to validate the credentials...
Handling connection for 31111
Cannot connect to OpenFaaS on URL: http://<IP_ADDRESS>:31111. Get "http://<IP_ADDRESS>:31111/system/functions": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
Deploying: github-push.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: buildshiprun.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: github-status.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: pipeline-log.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: list-functions.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: metrics.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: function-logs.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: system-github-event.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: garbage-collect.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: import-secrets.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: audit-event.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: echo.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Deploying: git-tar.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Function 'github-status' failed to deploy with status code: 401
Function 'pipeline-log' failed to deploy with status code: 401
Function 'function-logs' failed to deploy with status code: 401
Function 'system-github-event' failed to deploy with status code: 401
Function 'garbage-collect' failed to deploy with status code: 401
Function 'import-secrets' failed to deploy with status code: 401
Function 'git-tar' failed to deploy with status code: 401
Function 'github-push' failed to deploy with status code: 401
Function 'buildshiprun' failed to deploy with status code: 401
Function 'list-functions' failed to deploy with status code: 401
Function 'metrics' failed to deploy with status code: 401
Function 'audit-event' failed to deploy with status code: 401
Function 'echo' failed to deploy with status code: 401
Fetch templates from repository: https://github.com/openfaas/templates.git at master
Deploying: system-dashboard.
WARNING! Communication is not secure, please consider using HTTPS. Letsencrypt.org offers free SSL/TLS certificates.
Handling connection for 31111

unauthorized access, run "faas-cli login" to setup authentication for this server

Function 'system-dashboard' failed to deploy with status code: 401

Steps to Reproduce (for bugs)

ofc-bootstrap create-github-app

ofc-bootstrap apply --file init.yaml

Context

Your Environment

faas-cli version ( full output ): 0.12.4

Docker version docker version (e.g. Docker 17.0.05 ): 19.03.5

Kubernetes version kubectl version:

Client Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.5", GitCommit:"20c265fef0741dd71a66480e35bd69f18351daea", GitTreeState:"clean", BuildDate:"2019-10-15T19:16:51Z", GoVersion:"go1.12.10", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.2", GitCommit:"52c56ce7a8272c798dbc29846288d7cd9fbae032", GitTreeState:"clean", BuildDate:"2020-04-30T20:19:45Z", GoVersion:"go1.13.9", Compiler:"gc", Platform:"linux/amd64"}

Are you using faas-netes or the Operator? Unsure

Operating System and version (e.g. Linux, Windows, MacOS): MacOS

Link to your project or a code example to reproduce issue:

Please also follow the troubleshooting guide and paste in any other diagnostic information you have:

init.yaml
secrets:
  ### Generated secrets (do not edit)
  - name: basic-auth
    literals:
      - name: basic-auth-user
        value: admin
      - name: basic-auth-password
        value: ""
    filters:
      - "default"
    namespace: "openfaas"
  - name: "payload-secret"
    literals:
      - name: payload-secret
        value: ""
    filters:
      - "default"
    namespace: "openfaas"
  - name: "jwt-private-key"
    files:
      - name: "key"
        value_from: "./tmp/key"
        value_command: "openssl ecparam -genkey -name prime256v1 -noout -out ./tmp/key"
    filters:
      - "auth"
    namespace: "openfaas"
  - name: "jwt-public-key"
    files:
      - name: "key.pub"
        value_from: "./tmp/key.pub"
        value_command: "openssl ec -in ./tmp/key -pubout -out ./tmp/key.pub"
    filters:
      - "auth"
    namespace: "openfaas"

  ### User-input
  ### In this section, you must populate all your secrets or secret file-locations
  ### and your desired configuration.
  ### For more information see: https://github.com/openfaas/openfaas-cloud/tree/master/docs
  - name: github-webhook-secret
    literals:
    - name: github-webhook-secret
      value: e...
    namespace: openfaas-fn
    filters:
    - scm_github
  - name: private-key
    literals:
    - name: private-key
      value: |
        -----BEGIN RSA PRIVATE KEY-----
        MI...
        -----END RSA PRIVATE KEY-----
    namespace: openfaas-fn
    filters:
    - scm_github
  - name: "of-client-secret"
    literals:
      - name: of-client-secret
        value: "1....."
    filters:
      - "auth"
    namespace: "openfaas"

 # DNS Service Account secret for DNS01 (wildcard) challenge

  ## Use DigitalOcean
  ### Create a Personal Access Token and save it into a file, with no new-lines
  - name: "digitalocean-dns"
    literals:
      - name: "access-token"
        value: "4......"
    filters:
      - "do_dns01"
    namespace: "cert-manager"

  # Used by Buildkit to push images to your registry
  - name: "registry-secret"
    files:
      - name: "config.json"
        value_from: "./credentials/config.json"
    filters:
      - "default"
    namespace: "openfaas"

  # Used to pull functions / images to nodes by Kubernetes
  - name: "registry-pull-secret"
    files:
      - name: ".dockerconfigjson"
        value_from: "./credentials/config.json"
    namespace: "openfaas-fn"
    filters:
      - "default"
    type: "kubernetes.io/dockerconfigjson"

## If not using a HTTPS URL, then set a list of CUSTOMERS
## To use this set "value_from" to a real file path, and put in a list (each item on a new line) of usernames, without other whitespace
  - name: "of-customers"
    files:
      - name: "of-customers"
        value_from: "/Users/codedawi/go/src/github.com/openfaas-incubator/ofc-bootstrap/CUSTOMERS"
    namespace: "openfaas"
    filters:
      - "default"
  - name: "customers"
    files:
      - name: "customers"
        value_from: "/Users/codedawi/go/src/github.com/openfaas-incubator/ofc-bootstrap/CUSTOMERS"
    namespace: "openfaas-fn"
    filters:
      - "default"

### Docker registry
#### This can be any cluster accessible by your cluster. To populate the file
#### run `docker login` with "store in keychain" turned off in Docker Desktop.
#### This can also be your private registry
#### Format: registry/username/ - i.e. replace ofctest with your login

registry: docker.io/codedawi/

### Use a secret instead of a publicly accessible URL for the ACL
### of valid users.
customers_secret: false

### Your root DNS domain name, this can be a sub-domain i.e. staging.o6s.io / prod.o6s.io
root_domain: "staging.codedawi.com"

## Ingress into OpenFaaS Cloud

### Keep active if using a cluster with a LoadBalancer available.
ingress: loadbalancer

### Uncomment if using on-premises or a host/cloud without a loadbalancer
# ingress: host

## Define the custom templates available for your users
### If needed edit the git-tar Deployment after running the tool
deployment:
  custom_templates:
    - "https://github.com/openfaas-incubator/golang-http-template.git"
    - "https://github.com/openfaas-incubator/node10-express-template.git"
    - "https://github.com/openfaas-incubator/python-flask-template.git"
    - "https://github.com/openfaas-incubator/ruby-http"

## Source Control Management
### Pick either github or gitlab
scm: github
# scm: gitlab

## Populate from GitHub App
github:
  app_id: "70659"

## Enable auth:
### When enabled users must log in with a valid GitHub account and be present in the
### customers file to view any dashboard
enable_oauth: true

## Populate from OAuth App
oauth:
  client_id: Iv1.aa3f5a0df95ba477

  ## For GitLab put your OAuth provider base URL
  # oauth_provider_base_url: "https://gitlab.o6s.io"

  ## For GitHub leave blank
  oauth_provider_base_url: ""

## Slack
### You can set your own url to get an audit trail in your Slack workspace
### You can edit this after deployment if needed in the audit function
# slack:
#   url: http://gateway.openfaas:8080/function/echo

### Users allowed to access your OpenFaaS Cloud
#### ACL for your users, it must be a raw text file or GitHub RAW URL
#### At time of writing this _must_ be a public repo URL
customers_url: "https://raw.githubusercontent.com/codedawi/faas/master/CUSTOMERS"

##  S3 configuration
### Build logs from buildkit are stored in S3
### Defaults to in-cluster deployment of Minio. AWS S3 is also possible
s3:
  s3_url: cloud-minio.openfaas.svc.cluster.local:9000
  s3_region: us-east-1
  s3_tls: false
  s3_bucket: pipeline

## TLS
tls: true
tls_config:
  # issuer_type: "prod"
  issuer_type: "staging"
  email<EMAIL_ADDRESS>
  ## Select DNS web service between Amazon Route 53 (route53) and Google Cloud DNS (clouddns)
  # by uncommenting the required option

  ### DigitalOcean
  dns_service: digitalocean

  ### Google Cloud DNS
  # dns_service: clouddns
  # project_id: "my-openfaas-cloud"

  ### AWS Route53
  # dns_service: route53
  # region: us-east-1
  # access_key_id: ASYAKIUJE8AYRQQ7DU3M

  ### Cloudflare
  # dns_service: cloudflare

## Dockerfile language support
### Use with caution, it allows any workload to be built and run
enable_dockerfile_lang: false

## Set to true to enable scaling to zero
### When enabled, all functions are included by default, to turn off add a label
### of com.openfaas.scale.zero: "false"
scale_to_zero: false

## Enable network policies
### Prevents functions from talking to the openfaas namespace, and to each other.
### Use the ingress address for the gateway or the external IP instead.
network_policies: false

## Branch that OpenFaaS Cloud will build and deploy
## You should change this if you want a different branch to be built and deployed instead of master
build_branch: master

## Version of OpenFaaS Cloud from https://github.com/openfaas/openfaas-cloud/releases/
openfaas_cloud_version: 0.13.10

## This setting, if true, will install the openfaas ingress-operator
enable_ingress_operator: false

/set title: Support request

Hi thanks for your interest in the project, we deliver user support via Slack and not via GitHub issues.
For that reason let's get this closed, and move across if you need further help?
I would also suggest that if you've re-run ofc-bootstrap against the same cluster more than once, that you delete the cluster or pick a new one to run against. ofc-bootstrap offers no guarantees about being re-runnable and the error you posted is likely to happen if you have left over processes or port-forwardings.
Alex

/msg: slack

okay thank you my apologies

From looking at your error it looks like an environmental issue from re-running the bootstrap > 1 time, or something else like a timing issue. You can try destroying the cluster and re-running. We'll see you on Slack, let us know how far you got?

Definitely could be the issue, I was trying a few different things with a handful of clusters (both managed and local). I am probably going to have time tonight to mess around. Also, I submitted my request to join the Slack. Thanks again for your responsiveness and help such far. Cheers.


Add actions to scroll the list by a page

Problem
I looked in https://github.com/alexpasmantier/television/blob/65bb26ec847e0d2caae49fbaeb3bffef90e094cd/crates/television/action.rs#L6 but did not find an action that would let me page through the result list, which ideally would be bound to Page-up/Page-down.
Feature
An action to page through the results list.
Examples
[keybindings.Channel]
pageup = "SelectNextPageEntry"
pagedown = "SelectPrevPageEntry"

Additional context
Here's how it works in fzf:
https://github.com/user-attachments/assets/d87a228c-e4be-49a5-a993-a211f1bdffc2

Added the action in #72


Pople placeholders

The following values are just placeholders and have incorrect values:
6-21G-core_binkley1980a

Fixed in 746bde5a3f2bb0873933253849e91d4b084ca106


SolveSuperclass

Given this example:
class B extends A {
}

class C extends B {
}

We need to find the superclasses of C (A and B).
We have most of the logic in place for that, but I could write the last bit for this particular case.
I would write a function named "solveSuperclass" in funcs.clj which would get a ClassDeclaration instance and basically call
(solveClass  classDeclaration nil (.getSuperclass classDeclaration)

solveClass is a method from a protocol.
Once we have this function we can create getAllSuperclasses calling recursively solveSuperclass.

It should be fixed now.
@davidor you can now use solveSuperclass (to get the direct parent class) and getAllSuperclasses (to get all the parents, recurisively)
Do not expect it to work all the times :)
To solve types not in the same file you should set the dynamic variable typeSolver.
Probably you want to do something like:
(def typeSolver (typeSolverOnList my-list-of-type-declarations))

where my-list-of-type-declarations is a list of type declarations (classes, enums, interfaces). To get a list of type declarations you can get a list of compilation units and call (flatten (map allTypes cus))
If you have any questions feel absolutely free to write me/ping me!

(closing this issue because it should be solved)


LFS Roadmap: v1.5.0 -> v2.0

You may have noticed references to new LFS version numbers flying around these
Issues and Milestones. Here's our current plan for the next few Git LFS
releases:
v1.5.0
This is an exciting release for us, especially @larsxschneider. LFS's biggest
complaint is how slow it is. Unfortunately, a big part of that has to do with
Git's clean and smudge filter implementation, which was never designed for
something like LFS.
@larsxschneider dropped #1382 on us, which claimed to speed up git branch
changes up to 70x with a new filter process feature in Git. After several
months of patches with the git core team, the filter process feature was
accepted for Git v2.11.
Since then, @larsxschneider and @ttaylorr have been jamming on the Git LFS
implementation of this feature, and it is now nearly ready: #1617.
A couple other things are slated for Git LFS v1.5.0 too:

Allow usage of proxies even when contacting localhost #1650
Fast directory walk #1616

View progress in the v1.5.0 milestone.
v2.0
Since its release over a year ago, Git LFS has been carrying around a lot of
baggage. Git LFS v2.0 removes that baggage, and redesigns some of the core
systems.

Scanner - The Scanner extracts LFS pointer objects from a range of Git commits.
Our goal is to make the scanner asynchronous so that transfers can begin
immediately when trying to push a large Git history. #1649
Transfer Queue - The transfer queue will be reworked to support the new
Scanner, and handle network issues better.
Filter Process - We want to investigate parallel downloads during long
clone/pull operations.

The bulk of the baggage is the support for the Git LFS legacy API, which is
removed in #1629. There are also a number legacy commands to remove too.
View progress in the v2.0 milestone.
File Locking
@sinbad is currently experimenting with File Locking. There's no set release
yet, but it is looking promising:

Locking part 1: locking package #1625
Locking Proposal

Thanks for writing this up! 🎉
I'm going to post more detailed issues with proposals and high-level overviews of the types of improvements I'd like to make in both the scanner, transfer queue, and the filter process.
@larsxschneider and I have already begun talking about adding a new capability to the protocol to allow the git-filter-server (LFS) to "promise" that it will convert a file and yield the path on disk where it will dump the result of that conversion. The git-filter-client (Git) can then wait until LFS sends back an "I'm done with everything you asked for", and then Git will move those files into the appropriate locations.
This will allow us to process many transfers concurrently, taking full advantage of the proposed new transfer queue design, and yielding even greater speeds for the new filter protocol implementation. Perhaps more importantly, it will allow us to do normal Git operations (git clone, git push, git pull, and etc.) without needing to temporarily disable the smudge filter to parallelize the transfers. This means that, in-effect, we could get rid of the git lfs <pull|clone|push> commands entirely, which is something that I'd be very excited about.

Nice 👍 I'm glad I at least managed to finish something for 1.5 at least :)

Updated above to reference the first issue for lfs 2.0: Proposal: git/gitscanner package for v2.0 #1649

Updated above to reference the first issue for lfs 2.0: Proposal: git/gitscanner package for v2.0 #1649

Did the same for the transfer queue work outlined in #1651.


bug(Drag and Drop): Unable to hide placeholder

Reproduction
https://stackblitz.com/edit/angular-rqnoae?file=src/app/cdk-drag-drop-sorting-example.css
Steps to reproduce:

set display:none in .cdk-drag-placeholder

Expected Behavior
Moving item should not take space in list
Actual Behavior
There is a small white space in list

This isn't something we support at the moment, because the placeholder is used for measurements and to figure out where to animate the preview to once the user stops dragging. You can try setting height: 1px; opacity: 0 on it.


What are the settings of the head in GFNet for segmentation?

Hello,
Thank you for your nice work! I am curious about the settings of the head of GFNet for segmentation. Will you share more details? Thank you!

Thanks for your interest in our work.
We apply our backbone model to the semantic FPN method as mentioned in our paper. We follow the configuration of PVT  for a fair comparison. We can refer to the implementation of PVT (https://github.com/whai362/PVT/tree/v1/segmentation).

Thanks, @raoyongming


Transactions bulk editing

https://github.com/NickvisionApps/Denaro/discussions/348#discussioncomment-5934518
I think a label "N transactions" can be replaced with a button that will open a dialog similar to transaction dialog but only with fields that make sense for bulk editing (groups, dates, tags).

This would be a very helpful addition to Denaro, imho.
I want/need to add tags and groups to a several thousand transactions. The filter mechnism is very helpful at finding the right transactions already, editing all or a selection of the search result will improve the usability tremendously.

So looking to do bulk edits within the GUI instead of needing a secondary tool. Right now I download transactions from other locations so trying to import them with their groups or tags would mean putting them through a transformation script and then editing to add groups and tags.
Use case:
I have a bucket for "Mandatory bills" and tags for tracking individual portions. I'd like a easy way via the GUI to select save 15 items and add them to the "Mandatory bills group" Then maybe go into that group later and select the 5 in there that are all related to XYZ and add the Tag XYZ to just those.
Perhaps clicking on the ID # itself


Update UE5 main from UE4 main (EXT_feature_metadata styling)

Thanks for the pull request @nithinp7!

:heavy_check_mark: Signed CLA found.

Reviewers, don't forget to make sure that:

[ ] Cesium for Unreal Samples works.


Installation not possible

When installing on Mac, the JuliaUp program errors out and generates the following log files. I have changed the file ending from .toml to .log for upload.
report-0d97f602-4160-4039-ad72-931ce0b78316.log
report-82f2fba7-156c-438d-800f-dc3cf7c70c7a.log

Looks like this should be filed on the juliaup repo:
"name" = "Juliainstaller"
"operating_system" = "Mac OS 14.1.2 [64-bit]"
"crate_version" = "1.13.0"
"explanation" = """
Panic occurred in file 'src/operations.rs' at line 794
"""
"cause" = """
called `Result::unwrap()` on an `Err` value: Failed to open file /Users/s2268228/.bash_profile.

Caused by:
    Permission denied (os error 13)"""
"method" = "Panic"
"backtrace" = """

   0: 0x10109ed24 - core::result::unwrap_failed::hc60ef978ea39e1b4
   1: 0x100f0f8a0 - juliaup::command_config_modifypath::run_command_config_modifypath::h128619761258fbf1
   2: 0x100e03e5c - juliainstaller::main::hc82ac1c4f214aa33
   3: 0x100dee040 - std::sys_common::backtrace::__rust_begin_short_backtrace::had196ea5bb642008
   4: 0x100dee960 - std::rt::lang_start::hb2e78bef159560e2
   5: 0x100e09d6c - _main"""

Looks like this should be filed on the juliaup repo:

Yeah, I've transferred it to the Juliaup repo.

"name" = "Juliainstaller"
"operating_system" = "Ubuntu 22.04 (jammy) [64-bit]"
"crate_version" = "1.14.5"
"explanation" = """
Panic occurred in file 'src/operations.rs' at line 1021
"""
"cause" = """
called `Result::unwrap()` on an `Err` value: Failed to open file /home/b-ry-jr/.zshrc.

Caused by:
    Permission denied (os error 13)"""
"method" = "Panic"
"backtrace" = """

   0: 0x7f3518fcba65 - juliaup::command_config_modifypath::run_command_config_modifypath::h8c575168682c64d5
   1: 0x7f3518e7851a - juliainstaller::main::h3fc8adcf7e45ce1b
   2: 0x7f3518e5ea03 - std::sys_common::backtrace::__rust_begin_short_backtrace::h36a1912cbf06ac8a
   3: 0x7f3518e5f403 - std::rt::lang_start::h53ae6b99325d4862"""

This looks similar.

Second user was able to resolve the issue by fixing access to .zshrc.
@astro-kevin , is there a reason that /Users/s2268228/.bash_profile is inaccessible?

I gave write permissions to all users and that seems to have fixed it.

All users? Are you trying to create a multiuser installation? Julia has some distinct facilities to enable this.

I'm not, but in the permissions GUI in MacOS, there's the option to enable read/write permissions for system only, myself, or all users. I changed it to all users because that seems to be the most permissive option and it seems to have worked. I probably works if I changed it to myself only, but I didn't test that.


Add an internal incarnation number/id to the index id for the control plane

Currently, the control plane has a dreadful glitch if we delete an index and swiftly recreate an index with the exact same name. (This is a rather common operation.)
The control plane will not have time to stop existing pipelines, and will be perfectly happy to see a pipeline already running with the specified index id.
As a fix for #3036, I suggest we introduce the notion of incarnation number for our index id.
This number is never used/shown to the user.
The index id is still unique at any moment of time.
The point of this incarnation id is to make it natural for the control plane to  notice that the instance before the delete/create operaiton has happened is obsolete.
In the future, this incarnatin is also an elegant way to allow a change of conifguration.
We can simply bump the incarnation number when a change is operated.
We also need to take change the incarnation of clear index for the same reasons.

We probably want to do the same thing at the source level. For handling delete/create of a source and reset-checkpoint.

Assigned to @imotov


Custom Errors return null and error message unable to apply transaction even for the highest gas limit 50000000

Custom Errors return null and error message unable to apply transaction even for the highest gas limit 50000000## Description
Hi, I have a smart contract with a custom error.
  function _checkHasAccess(bytes32 _senderRole) internal view virtual {
        if ( _hasAccess(__senderRole))) {
           revert PermissionedContractAccessDenied();
        }
    }

On ethersJs, when I submit a transaction with an unauthorized role. It should return the customer error on the data property, but instead, it returns data = null and a message.
{message: 'unable to apply transaction even for the highest gas limit 50000000: execution reverted'}

On Mumbai, it gives me the correct error message.
"message": "Custom error: PermissionedContractAccessDenied",

Your environment

macOS Ventura 13.4.1
Polygon version v1.0.1
v1.0.1
Cloud hosted

Steps to reproduce

Add any smart contract with a customer error
Use Ethersjs to submit a tx
The error data will be null without any bytes value to decode

Expected behavior

Expected reverted transaction object should look like this

    code: 'CALL_EXCEPTION',
    action: 'estimateGas',
    data: '0x8cd01c38',
    reason: null,
    transaction: {
      to: '0x81cA45368Af26a91A74B91Bf4Ae5017c5AaB0703',
      data: '0x06244ace000000000000000000000000000000000000000000000000000000000000000036346434633731373430393564626534613963633034656300000000000000003634643334663335326163666462343463373362396431360000000000000000',
      from: '0x877427CCBd3061Affd5c6518bc87799B9Cf3C408'
    },
    invocation: null,
    revert: null,
    info: {
    error: { code: 3, message: 'execution reverted', data: '0x8cd01c38' },
    payload: {
      method: 'eth_estimateGas',
      params: [Array],
      id: 4,
      jsonrpc: '2.0'
    }
  },

}

What happened instead.

   code: 'CALL_EXCEPTION',
    action: 'estimateGas',
    data: null,
    reason: null,
    transaction: {
      to: '0x8aCB619584817f3D9d587c3806b8c18B95Fb33fe',
      data: '0x06244ace46554e445f41444d494e5f524f4c45000000000000000000000000000000000036346434633930653835303035343635303735353766396500000000000000003634643334663335326163666462343463373362396431360000000000000000',
      from: '0x877427CCBd3061Affd5c6518bc87799B9Cf3C408'
    },
    invocation: null,
    revert: null,
  info: {
    error: {
      code: -32603,
      message: 'unable to apply transaction even for the highest gas limit 50000000: execution reverted'
    },
    payload: {
      method: 'eth_estimateGas',
      params: [Array],
      id: 4,
      jsonrpc: '2.0'
    }
  }
  },

}

Hello @yehia67
Visit the Ethereum official website to report and resolve this issue.
Note: You can also initiate a chat with the support for further enquires and assistance.

Hey @Hearness
Thank you for your reply, I did ask them, but I don't think it is related to Etherjs

As I said above, it works with Mumbai.
I did the transaction from the foundry, and it gives the same issue

there is a typo in your code the condition should be if (!_hasAccess(_senderRole)) instead of if ( _hasAccess(__senderRole)).
function _checkHasAccess(bytes32 _senderRole) internal view virtual {     if (!_hasAccess(_senderRole)) {         revert("PermissionedContractAccessDenied");     } }

Hello @Slitherings thank you for mentioning this but this a PoC to test the custom errors functionality


Added awesome projects boilerplates

Nice, thank you Melvin! I've slightly modified the commit and pushed it in d4c632e97079c2348fe4f516bf4608684140740d


Feedback - using F#+

@wallymathieu I wonder if you're using the library for some projects, prototyping or just playing with the exotic typeclassy features?
I'm just curious and at the same time I would like to know if there's any stuff you would like to see added to this lib.

I'm looking into extension libraries of f# in order to write some nice f#. I've started using dotnet core quite a lot, so it natural to try to transition libraries so that you can use them from that environment.
I like for instance common computation expressions, since they can make for cleaner code.
I don't have a specific use case in mind right now.

One thing that might need transitioning is add Result<,> instead of Choice<,>. There are a lot of libraries still using Choice<,> out there, so probably something that will take years to transition.

I like for instance common computation expressions, since they can make for cleaner code.

Precisely right now I'm trying to improve them (see https://github.com/gusty/FSharpPlus/issues/32)

One thing that might need transitioning is add Result<,>

Yes, and also the ValueTuple, I still didn't found the time to analyze the impact, but would be nice to transition, or even better include them keeping the existing ones. Feel free to open an Issue regarding this.
Thanks, for your feedback, and also your contributions, this project is too big for a single developer, that's why I'm asking, because I dream to make it a community effort. One problem is that the typeclassy stuff is very complicated to get people contributing, but that's just a part of the project, there are many areas to contribute, specially in the design discussions.

I would love to grok the typeclassy things. A lot of the monads have been done in extcore. Maybe inspiration can be found there.

I think ExtCore takes a different approach. As most other base libraries it defines the classic monads and some combinations of them, by hand. Here we have monad transformers which allow us to combine them at your discretion. Both approaches have goods and bads, I'm not a big fan of Monad Transformers, even in Haskell, but at the moment it's the most flexible approach.
I think most basic monads from ExtCore are already implemented here, let me know if we're missing something.
Regarding the computation expressions, I did had a look at the way there were implemented there in ExtCore, and found some inspiration, but also found that they have to choose one specific implementation (sequencing fx or monad plus) while leaving away the other one.
Having said all this, I don't discard adding some common custom combined monads at some point, as the ones in ExtCore or in FSharpX, or as the AsyncSeq.

Btw, one thing I've been curious about is the inherit Default1. Is it in order to be able to declare several methods with different statically resolved type parameters?

It's a way to have some control over the overload resolution, specially for the default implementations, therefore the name.
The basic idea is that we have default implementations, for example the method Join for a specific type can be derived automatically if that type is a monad that has Bind and Return (see monad)but you can also have a specific Join overload for that type which might be more optimized.
So if the overload for that type doesn't exists it has to use the default implementation, which is generic for any monad. In that case we want the overload resolution to give priority to the specific type and if it doesn't exists default to the default implementations.
Since overload resolution rules give priority to base classes by having a default that is a superclass of the class containing the overloads we achieve such behavior.

Aaa, interesting! Thanks for the explanation!

I find this library really interesting. It takes the f# language in a different way than perhaps intended by dsyme, so perhaps having a fork of component-design-guidelines would be appropriate for f#+ style code?

I'm not getting the feeling that you intend for f#+ code to be consumed by for instance c#? So many of the guidelines related to interop don't really apply.

Yes, a guideline and in general more doc is definitely something we should aim to, if we expect more adoption.
By taking advantage of your fresh point of view as adopter of this library (mine is well contaminated), do you have any idea of what stuff such a guideline should cover?
Regarding C# I changed my mind many times :)
It's really a nice to have, but there are many problems, some of them don't exists anymore with current state of things, but the main issue is that inlined stuff doesn't work from C#.
So, I decided to focus initially in F# and then see if there is space for some C# usability.
See for example the [issue regarding extension members[(https://github.com/gusty/FSharpPlus/issues/42) to get a feeling of it. Of course feel free to reopen the discussion.

To add more context, I imagine guidelines and C# integration in different scenarios:

Direct use: Just calling functions and methods, or using types from this library
Integration with other libraries: For instance your how to make your Validation project integrated with F#+
Contribute to this library. Although it might sound complicated (and for some areas it really is) there are many areas in which is easy to contribute.
Create libraries alike. This is not clear for me at the moment, but an example might be Fleece which also makes use of this library at the same time.

The source for the validation library is more intended as a place to work on it without polluting f#+. Perhaps some of the tests could be useful and a curated amount of methods if it's something that should be part of f#+. If it's supposed to be a separate lib, then perhaps it should be named something else like FSharpPlus.Validations ?

Yes, actually I took it as an example.
Then at some point of course we can decide to merge it here, which if you ask me I think would be a really good addition, not to say a must have, given the amount of blogs you see about validation and ROP nowadays.

BTW, also the FsCheck stuff you're doing there is something that definitely belongs to this library, given all the rules we're trying to stick to. We never checked. I was more worried about testing compile-time behavior than run-time.

Some of the ROP and validations could perhaps benefit from seeing a f#+ implementation with a bit more thought.

Since I've started reading more about it, it feels like there are some confusing aspects of mixing validations with result since one is applicative and one is not.

Some of the ROP and validations could perhaps benefit from seeing a f#+ implementation with a bit more thought.

Sure, but that requires not just writing the code. It would require writing examples and possible blogging about it.
Applicative validation was something I had in mind to add since many years, along with other stuff like LazyList (with its transformer), RoseTree, Observable extensions, Tasks, Quotations, Lenses and many other areas that I think are key to a decent base library.
If all the above stuff is not here today is just because I don't have infinite time and was more focused on the type-classy stuff that gives me many headaches, including digging into the F# compiler code and eventually trying to fix it. But that's just only one aspect of this library (although it's probably the most distinctive).

one is applicative and one is not.

Which one is not applicative?

Result

It is:
static member inline Map (x : '``Applicative<'T>``, f : 'T->'U, [<Optional>]_impl:Default3) = Apply.InvokeOnInstance (Return.InvokeOnInstance f) x : '``Applicative<'U>``
static member ``<*>`` (f:Result<_,'E>, x:Result<'T,'E>  , [<Optional>]_output:Result<'b,'E>, [<Optional>]_impl:Apply) = Result.apply f x: Result<'U,'E>

Maybe you mean Alternative?

You are right of course. 👍

In that case, I would say none of them is in the strict sense an Alternative, simply because there is no unique empty value.
But, both of them can be considered as Alt which only requires <|>.
Choice has many ways to define <|> we'll probably end up implementing it as the mOrElse function, but there are other valid implementations.
For Validation the situation seems to be less confusing, probably because it's more specific, but the behaviour is exactly the same.
Although Result is isomorphic to Choice it express (by the names) the intention, so here it's also clear the mOrElse difinition.
BTW, I'm always tempted to add an (possible ad-hoc) IsFailure method to get a generic isFailure function.
This is interesting to generalize over types that model failures (all the above, plus option) and it is particularly interesting to allow traversing infinite lists.

Why the sense to include Alt in f#+.

What do you mean? Are you asking to include Alt?
Alt as most other typeclasses is already implicitly included.
We just need to add it to the docs.
We don't handle typeclasses like in Haskell here, we just generalize over the individual operations.
Then we name some 'abstractions' according to rules and operations.
If that's not what you mean please let me know.

As you said, even if the abstraction are not possible to have part of the language, they can still be in the docs.

Yes, well is not that is not possible, I think there is an (ugly) way to enforce group of operations.
But the question is whether it makes sense.
Nowadays in Haskell as you may have already seen, they have a lot of repetitive and redundant code, because they also have more granular type classes, and everyday they are trying to come with more partitions.
In the end the typeclasses also have to obey (run-time) rules, so by doing that effort you still don't have any compiler guarantee. So why go in their direction when they're are going to ours?
Feel free to add Alt to the docs, or to name the type parameters as 'Alt where it makes sense.
PS: I think there is an old issue when we started FsControl, where we discussed all this mess in the Haskell world and finally we decided to take this direction.

I've seen some of the mess that is Haskell. I think I noticed that there are a lot of weirdness when it comes to record syntax. I think I could partially implement type classes. Sometimes it feel more like a thing to enable overloading. But there are lots of interesting things that you can learn from Haskell (I've not learned enough though).

Sometimes it feel more like a thing to enable overloading.

Yes, that was the original goal. Typeclasses is the way to do overlaoding in Haskell

But there are lots of interesting things that you can learn from Haskell (I've not learned enough though).

Millions, but since it has two decades (as of today ;) ) there are lot of lesson learned stuff as well. I'm sure that if they start doing Haskell again (form scratch) there will be many differences.

Have I got it right?

Operation
F#+
F#
Haskell

map
<!>

<$>

apply (combine)
<*>

<*>

*>

alternatives: binary operation
<|>

<|>

append
++

List.append

@
++

<<
.

<|
$

=
==

<>
=/

Yes, looks good.
Maybe it's possible to collapse F#+ and F# in one.
The idea is that there shouldn't be differences unless you open a specific namespace like the Math operators which redefines some F# core stuff.
That table should go to the docs !

I've merged the columns:
Operation | F#+ / F# | Haskell
-- | -- | --
map | <!> | <$>
apply (combine) | <*> | <*>
alternatives: binary operation | <\|> | <\|>
append | ++ |
List.append | @ | ++
  | << | .
  | <\| | $
  | = | ==
  | <> | =/


Refactor the bmcrypto keytype system

We have multiple key types, which are now located in bmcrypto.KeyType. Throughout the code, there is a lot of switch statements that deal with specific key types.
Let's try and find a way to refactor this in a more common system: each keytype implements a interface that can be implemented

close on #77


Add transferwise variant of tap-salesforce

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/2418
Originally created by @DouweM on 2020-11-05 23:14:17

https://github.com/transferwise/pipelinewise-tap-salesforce
https://transferwise.github.io/pipelinewise/connectors/taps/salesforce.html

View 3 previous comments from the original issue on GitLab

Closing as stale.


MSID: 91930 Version: 2 DOI: 10.1101/2<IP_ADDRESS>3641

MSID: 91930
Version: 2
Preprint DOI: https://doi.org/10.1101/2<IP_ADDRESS>3641
Step 1. Awaiting reviews
Editorial to post reviews via hypothesis
Useful links:

DocMap: https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v2/by-publisher/elife/get-by-manuscript-id?manuscript_id=91930
New model tracking: https://docs.google.com/spreadsheets/d/1_fHaoOy7hjyocptKtVJRijeNpUY4hBS7Ck_aVmx6ZJk/
Reviews on sciety: https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>3641

For trouble shooting (e.g. no Docmaps available):

DocMap issue addressing: https://miro.com/app/board/uXjVNCwK6EI=/
Explore DataHub DocMaps API: https://lookerstudio.google.com/reporting/4c2f0368-babb-4beb-b5b3-497e7e7b0f08/page/ejphD
Unmatched submissions and preprints: https://lookerstudio.google.com/u/0/reporting/9f86204f-3bf7-477c-9b18-5c5ef141bf69/page/p_gxi57ha93c
Unmatched manuscripts spreadsheet: https://docs.google.com/spreadsheets/d/15QcK8w-ssB7109RQEDtFpJPZ0J5HTGxoHa_2TtpMBbg/edit#gid=1336081641

Step 2. Preview reviewed preprint
Production QC content ahead of publication
Instructions:

QC preview: https://prod--epp.elifesciences.org/previews/91930v2
Update ticket with any problems (add blocked label)
When QC OK, add QC OK label to ticket and add publication date and time to https://docs.google.com/spreadsheets/d/1amAlKvdLcaDp5W8Z8g77NmkwbMF5n_u89ArSqPMO8jg
Move card to next column
(At end of the day post link in #enhanced-preprint and ask for PDF to be generated)

Useful links:

Preprint DOI :  https://doi.org/10.1101/2<IP_ADDRESS>3641
Confirm reviews returned by EPP: https://prod--epp.elifesciences.org/api/reviewed-preprints/91930/v2/reviews
To update the MECA path in the docmap: https://docs.google.com/spreadsheets/d/1mctCQuNFBjSn97Lihy7_vBO6z7-N-oqyLv4clyi6zHg

Step 3: Awaiting search reindex
This step adds the reviewed preprint to the homepage: https://elifesciences.org
The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.
Useful links:

Jenkins pipeline to reindex search can be triggered sooner or monitored here: https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 4: Published! PDF requested
Waiting for PDF to be generated
Useful links:

PDF tracking: https://docs.google.com/spreadsheets/d/106_XeDjmuBae7gexOTNzg60lapeqjl2aRn9DzupGyS8/

Step 5: Introduce PDF to data folder and git repo
Upload PDF to relevent folder in git repo https://github.com/elifesciences/enhanced-preprints-data/
Step 6: Done!

[ ] Kettle is on!


ollama run codeqwen TLS handshake timeout

What is the issue?
After I manually installed ollama locally, I started to try to run models, not only qianwne, but also llama3. But ping ollama.com does work. Since I am building ollama on the server, I was wondering if it would be possible to download the model file locally and drag it to the specified path on the server. If you can do this, could you give me some help? I don't know what path the pulled model should be placed under, thank you.
OS
Linux
GPU
Nvidia
CPU
AMD
Ollama version
0.1.32

Check out https://github.com/ollama/ollama/blob/main/docs/faq.md#where-are-models-stored for more information on where we store the models.

Check out https://github.com/ollama/ollama/blob/main/docs/faq.md#where-are-models-stored for more information on where we store the models.

At your prompt, I found the address where the model is stored. But I would like to try downloading the model file locally and manually deploying it to the relevant directory on the server. I see the file for the model in the image below. The help I need is as follows: 1. I need the URL to download these files manually.2. I need to know what the structure of my model file looks like. 3. Whether additional operations are required. Thank you very much!

merging with https://github.com/ollama/ollama/issues/3820


Shoutbox Bug...  see the screenshot!!

when typing symbols more then 3 to 4... the shoutbox windows is showing the symbols  as well as showing their perspective name too.. isn't this wierd... for example i had typed '??????' and shoutbox is showing '?????? ' why its showing '&quest,'
i have tested it with dolphin sample site...

#144
The fix - 150cd0ea480dc0bf5140e196da0c246c6376188e


Very strange behaviors while work with symfony/process and proc_open

What steps will reproduce the problem?
We are using trntv/yii2-command-bus to handle the asynchronous background process. The yii2-command-bus use symfony/process and proc_open to make a console/yii shell invoking. For example, assuming the final command generated by symfony/process was
/usr/bin/php /path/to/app/console/yii command-bus/handle TzoyOToiYbWblabla...== &

. Just the first parameter of proc_open.
And, the proc_open may failed, no error, no warning, nothing logged.
What is the expected result?
Yes, we wish the background job was normally processed. But, no luck.
After tons of experiments, we found out the following things.

If the YII_DEBUG = true, then proc_open always works fine, else see the following.
If the YII_DEBUG = false, though proc_open will failed, but if we make a Yii::warning() call before the proc_open statement, miracle will happen! It works! But, if using Yii::info() instead of Yii::warning(), it's no help (failed again).
The symfony/process synchronous call is normally(no care about YII_DEBUG), the scenario we meet is asynchronous call.

What do you get instead?
We have been confusing days and googling all the pattern we can try. So... we post this issue here.
Additional info
We are sure that the our related function code of console command-bus are tested and work normally some days before (with YII_DEBUG = false). What we did these days that have just made a composer update to the "vendors", it updated lots of components, including upgrade Yii 2.0.9 to 2.0.10. So sorry that we can't reproduce the environment as previous... Any suggestion is appreciated. Thanks everyone.

Q
A

Yii version
2.0.10

PHP version
7.0.14

Operating system
Centos 7.2

The code snippet of vendor/symfony/process/Process.php/start
...
if ('\\' === DIRECTORY_SEPARATOR && $this->enhanceWindowsCompatibility) {
	$commandline = 'cmd /V:ON /E:ON /D /C "('.$envline.$commandline.')';
	foreach ($this->processPipes->getFiles() as $offset => $filename) {
		$commandline .= ' '.$offset.'>'.ProcessUtils::escapeArgument($filename);
	}
	$commandline .= '"';

	if (!isset($this->options['bypass_shell'])) {
		$this->options['bypass_shell'] = true;
	}
} elseif (!$this->useFileHandles && $this->enhanceSigchildCompatibility && $this->isSigchildEnabled()) {
	// last exit code is output on the fourth pipe and caught to work around --enable-sigchild
	$descriptors[3] = array('pipe', 'w');

	// See https://unix.stackexchange.com/questions/71205/background-process-pipe-input
	$commandline = $envline.'{ ('.$this->commandline.') <&3 3<&- 3>/dev/null & } 3<&0;';
	$commandline .= 'pid=$!; echo $pid >&3; wait $pid; code=$?; echo $code >&3; exit $code';

	// Workaround for the bug, when PTS functionality is enabled.
	// @see : https://bugs.php.net/69442
	$ptsWorkaround = fopen(__FILE__, 'r');
} elseif ('' !== $envline) {
	$commandline = $envline.$commandline;
}
// if make a \Yii::warning call here, or with YII_DEBUG = true, proc_open will work normally. //by xie
$this->process = proc_open($commandline, $descriptors, $this->processPipes->pipes, $this->cwd, $env, $this->options);

if (!is_resource($this->process)) {
	throw new RuntimeException('Unable to launch a new process.');
}
$this->status = self::STATUS_STARTED;
...

Nothing obvious came to my mind. The issue seems to be complex... If everything worked before, there's a good way to find out. You say that it was fine with 2.0.9? Can you fix dependency version in composer.json, run update and try? If it works then you can find a commit introducing change that made everything broken using git bisect.

Thanks for your advice, @samdark ! We will try it soon and post the feedback.

Hi, @samdark ! Maybe some things become more complicated and interesting.... We find several slightly older host with different PHP versions. The following is the result of the experiment (Our vendor package of 2016-08-02 2016-10-06 2016-10-20 2016-11-25 2017-01-06 tested).
Host A:
Centos 7.2
PHP 7.0.11 (cli) (built: Sep 17 2016 09:23:18) ( NTS )
All the test passed, no matter YII_DEBUG or Yii 2.0.9 or 2.0.10.
Host B:
Centos 7.2
PHP 7.0.13 (cli) (built: Nov 10 2016 22:33:41) ( NTS )
Only YII_DEBUG=true or with Yii::warning() should pass, no matter Yii 2.0.9 or 2.0.10.
Host C:
Mac OSX 10.11.6
PHP 7.0.14 (cli) (built: Dec 20 2016 18:38:52) ( NTS )
All the test passed, no matter YII_DEBUG or Yii 2.0.9 or 2.0.10.
Now, I think the following facts can be confirmed.

This behavior is irrelevant to the version of Yii2 (My guess is wrong).
This behavior is relevant to the version of PHP (new speculation).

But, we still confusing about the YII_DEBUG and Yii::warning. Why do they affect the functionality of proc_open? Is there some method to dig into the proc_open? or YII_DEBUG and Yii::warning will affect the environment of proc_open runtime that out of the parameters passed to proc_open?

Why do they affect the functionality of proc_open?

No idea. They should not.

Is there some method to dig into the proc_open?

strace.

or YII_DEBUG and Yii::warning will affect the environment of proc_open runtime that out of the parameters passed to proc_open?

It looks like so. It could be error handler or additional logging...

Thanks @amdark ! We will try strace and feedback later.

@yanhuixie, what is the status of this ticket?

Oh, we are sorry, @dynasource . There is no conclusion yet, we have recently busing for other things, and will continue to this research some days later.


Allow dirty workflow in cargo-dist

Fixes CLI-47

Current dependencies on/for this PR:

main

PR #169   👈

This stack of pull requests is managed by Graphite.


sap_hana_install: quickfix

if sapcar is in a different directory than the IMDB* file, it cannot be used.
Hence I added "| basename" to the variable where the exact filename is needed. This doesn't change the behavior, but enables me to specify sap_hana_install_sapcar_filename relative to the HANA software directory.
EXAMPLE:
# sap_hana_install
#------------------
sap_hana_install_software_directory: /software/HANA_installation
sap_hana_install_sapcar_filename: ../SAPCAR/SAPCAR_1311-80000935.EXE
sap_hana_install_common_master_password: "R3dh4t$123"
sap_hana_install_sid: 'RHE'
sap_hana_install_instance_number: "00"

It is tested and works

merged, due to urgent need in a customer demo