BPF probe compile once run everywhere with BTF

This will likely become a proposal if it receives a good feedback here (like doing a :+1: counts as feedback )
What would you like to be added:
Adapt and compile our eBPF probe loader code to the BPF type format (BTF) - links below.
Why is this needed:
Some considerations first
One of the main barriers that new and old users encounter when trying to adopt falco is building either the kernel module or the BPF probe. To mitigate this we’ve been working on two main efforts over time:

doing containerized builds to minimize the host dependencies
having pre built kernel modules for a wide variety of kernels

Despite this, many users still struggle and in my opinion the experience in that area has a lot of room of improvement.
Moreover, in new-ish environments (recent kernel 4 and 5) using eBPF is becoming more and more common and honestly I expect that to become the default for Falco at some point. This also makes sense from a privileges point of view where we will only need capabilities for the bpf syscall .
Summary of Problems with our current approach

difficult to just run falco because the compilation or the download might not go right
kernel headers need to be installed on every host along with the clang tool chain that processes them
sometimes having kernel headers and tool chain is just very hard or impossible (immutable environments)
compiling is complicated, a single mistake and the user can’t load the loader and falco becomes useless
wider attack surface because having to compile stuff for the kernel requires a tool chain in a container that can read kernel folders (e.g /lib/modules)
difficult to distribute the “kernel side” of falco

The actual idea
After all these considerations I think that we need to adapt our current programs to take advantage of BTF (links below) in order to be able to compile once and run everywhere.
Read more about BTF here: https://www.kernel.org/doc/html/latest/bpf/btf.html and here https://facebookmicrosites.github.io/bpf/blog/2018/11/14/btf-enhancement.html
Next steps
After gathering some initial feedback here with this message I’ll open a formal proposal with an action plan

/assign @fntlnz
#dibs

/assign @leodido

For porting falco on ppc64le ,we are facing issues while using containers of docker files having older OS kernel version and gcc-6/5 dependent packages.
So above suggested changes are required, to support latest OS kernel version and latest gcc versions.
https://github.com/falcosecurity/falco/issues/982
https://github.com/falcosecurity/falco/pull/932

Fundamentally, to offer an eBPF agent to a system/kernel you do not yourself control, I would imagine you inevitably have to solve this problem to drive eBPF adoption. I started down this path as well after an analysis of BCC optimizations, bravo and consider this an upvote.

Thanks @jnach - I'd also love some help here in case you are up to!

Interested...

Also doing containerized builds to minimize the host dependencies - doesn't matter with eBPF, you can try an init container to make sure kernel-devel packages are there (which tends to break on update) or you can crack the code on CORE. The second one is particularly scalable.

I'm working on it.

Someday I might have enough free time to help lift, unfortunately the invisible hand says otherwise at the moment.

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Provide feedback via https://github.com/falcosecurity/community.
/close

@poiana: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Provide feedback via https://github.com/falcosecurity/community.
/close

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/reopen
/remove-lifecycle rotten
We still want this :)

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

/remove-lifecycle stale
@fntlnz Would we like to move this proposal to libs?


function nerdtree#ui_glue#invokeKeyMap[1]

Self-Diagnosis

[x] I have searched the issues for an answer to my question.
the same issue as https://github.com/preservim/nerdtree/issues/1184#issue-728875809
[x] I have reviewed the NERDTree documentation. :h NERDTree
[x] I have reviewed the Wiki.
[x] I have searched the web for an answer to my question.

Environment (for bug reports)

[x] Operating System:  macos 10.15.7
[x] Vim/Neovim version :echo v:version: 802
[x] NERDTree version, found on 1st line in NERDTree quickhelp ?:  6.9.10
[x] vimrc settings

[x] NERDTree variables

" NERDTree
let g:NERDTreeDirArrowExpandable = ''
let g:NERDTreeDirArrowCollapsible = ''
let g:NERDTreeMinimalUI = 1
" NERDTree窗口关闭标记列和关闭高亮列
autocmd FileType NERDTree set signcolumn=no | set nocuc

Other NERDTree-dependent Plugins

[ ] jistr/vim-nerdtree-tabs
[x] ryanoasis/vim-devicons
[ ] tiagofumo/vim-nerdtree-syntax-highlight
[ ] Xuyuanp/nerdtree-git-plugin
[ ] Others (specify):

[ ] I've verified the issue occurs with only NERDTree installed.

Steps to Reproduce the Issue

open a file into a buffer, select something via visual mode
press key x to cut
swich to the nerdtree window, then press key m to show the menu

Current Result (Include screenshots where appropriate.)

Expected Result

I cannot reproduce this error. It may have something to do with the Chinese characters. It looks like the error happens on the redraw! command on this line. If you look at the help file :h E315 you'll see that this should be reported to the Vim project. Make sure it is reproducible, and be very specific about the conditions that cause the error.

Thanks! I will  stay focused for this issue! It's an amazing issue. I found it out long time before, but never find out what‘s wrong about it. Maybe it's a bug for vim.


Theoretically Client-Side only mod isn't Client-Side only

Is this mod capable of becoming client side only?
it works perfectly fine in singleplayer, however has no effect when joining a vanilla server.

Sadly it isn't possible to make this a client-only mod, because the server doesn't send the required data to the client.

Sadly it isn't possible to make this a client-only mod, because the server doesn't send the required data to the client.

thats unfortunate, but understandable, thanks for letting me know

thats unfortunate, but understandable, thanks for letting me know


How to use threads?

Hey all, I am trying to run a Rust binary that uses threads and am getting an unsupported platform error
fn main() {
  std::thread::spawn(move || {
    println!("Hello, world from thread!");
  })
  .join()
  .unwrap();
}

Built with:
cargo build --release --target wasm32-wasi

Then in the console I use
$ wget http://localhost:8080/main.wasm
$ ./main.wasm

Hi @alshdavid, unfortunately threads are not yet supported by jswasi. However, we are planning to implement them at some point in the future.


fix: related field GraphQL [CU-23tr8vb]

Ticket
https://github.com/VirtusLab/strapi-plugin-navigation/issues/158
Summary
What does this PR do/solve?

Fixes type of navigation item related field in GraphQL Schema

Test Plan
How are you testing the work you're submitting?

Try to render a navigation item with a related field in both Tree and Flat format

Task linked: CU-23tr8vb [BUG] GraphQL 'Related' field error


add small walkthrough

Add a small walkthrough instructing how to make marz and a RIOT application work together and how to ping them from the outside. Took me a while to figure this out, so I thought I'd share. :)

Thank you.


Causing scroll behavior on mouse drag

I have a list that is sortable via drag and drop within a scrollable view using react-custom-scrollbars.  Is there any way to force the scroll region to scroll if the user is holding down the mouse button and drags to the bottom of the region?

Yes, I think there should be a way to do this. Look at the ShadowScrollbars example. There are two divs at the top and the bottom. You could register a mousedown handler and on the <Scrollbars> component (or the wrapper) and a mousemove on the top/bottom divs. If you drag an element (mousedown) and the mouse enters one of the divs (mousemove) you could do a step-wise scrolling with scrollbars.scrollTop(x).
Let me know if this works.

by the way: I noticed that in chrome this works out of the box.

After thinking again about it, you could also do this without the additional divs.
Register an mousemove handler on the <Scrollbars> component and while dragging check the distance between pointer and upper/lower edge. If it's near of one of the edges, scroll up/down.

That worked perfectly.  Thanks!

@malte-wessel @bunkat Do you have any example for this. I am also facing same issue, would be great help if you could provide any example of it.


Date Picker!  I really need it 😍

Hello @dsxksss
Could you please add a description of this issue?

Hello @dsxksss Could you please add a description of this issue?

Hi @yunweneric
I recently developed a Todo app that requires a date picker. The date picker UI provided by Flutter is not beautiful. It would be perfect if there were beautiful animation and interactive effects
This is my desktop app looks like

Sorry, I thought this was a component library, but I made a mistake

Hi @dsxksss
I like that date picker. It's true flutter widget hub is still growing to a full looking component library. We need to contribute to make it.
One of the goals of this project is to build an open source library for everyone to use. You can create an issue on this to updae the architecture of the project

Hi @dsxksss
I like that date picker. It's true flutter widget hub is still growing to a full looking component library. We need to contribute to make it.
One of the goals of this project is to build an open source library for everyone to use. You can create an issue on this to updae the architecture of the project

OK I get it, looks so good


Tests for plotting

As the recent update showed it could be handy to have some testing function for the plotting capabilities of HarmonicBalance. However, not sure how to test plotting other than testing if the plot funtion run.

So one can test the plot functionality by using VisualRegressionTests.jl of the Plots.jl ecosystem. If I understand correctly, one can use the package to test without adding it to the dependencies by adding it to extras in the project.toml file. @jkosata Can you confirm?

So I actually think this is maybe a bit of an overkill 😛. I think the basic running test that were implemented in #88 are enough for a package of our scale.


[Feature] Setup additional post deployment checks

As part of the 0.2.5 release we broke consumers.
We need to create a post-deployment set of tests that can validate that when consuming the deployed packages that nothing is broken / missing from the deployment.
Related : #65

https://github.com/nevware21/release-tests

The new release-tests project is now automatically built after the internal release job publishes any npm package.
While this won't stop the issue from occurring it will catch it eariler.
Currently, this performs an npm install and then clones and builds the current ApplicationInsights-JS project.
Other projects will and can be added to the package.json so that they will be validated upon release of any new packages.


Add .DS_Store

This is an example of how to do a commit message badly 🙂
Adds .DS_Store to .gitignore.

This is an example of how to do a commit message badly 🙂
Adds .DS_Store to .gitignore.

Indeed that's better. But it's not really good either, because it's entirely redundant with (i.e., doesn't say anything more than) the commit diff (which is part of the commit).
A more informative message might be something like Make macOS-specific files ignored by git. 😉😊


[WIP] Add temp table bulk loading

This is a feature I added to SqlClient which I would like to also include here
(Edit by @cmeeren: Closes #3)

Wow! This project has been published for a grand total of one single day, and already you have delved into the codebase and implemented a non-trivial feature like this. I'm impressed!
Since this is a non-trivial feature and there are several design decisions involved, I don't want to rush this PR. I'll try to have a close look at it over the coming days. In the meantime, could you provide some details about your design? Such as:

Why have you decided on the API you have? Have you considered other designs? Are there other designs that could mesh better with Facil's existing functionality? For example, loading temp tables seems like it would ideally be similar to the existing functionality and API for loading TVPs.
How, at a high level, is it implemented? (It will help me understand the PR and the decisions behind it better)

One thing I immediately notice (though I haven't considered it in light of the entire PR) is that you have SQL files with the temp table definition. I may prefer just having the temp table definition directly in the config.
(Also, sorry for the mess in Db.fs. It was the first file I wrote when prototyping, and I haven't gotten around to properly cleaning it up.)

Also, it seems that currently, there can only be one temp table per script (TempTable option field in Script). Again, I think that perhaps specifying temp tables on a per-parameter basis and using a similar interface to the current TVP stuff would be better.

By the way, since this may be a fairly major feature design-wise: If you want this implemented, but don't necessarily want to spend the time discussing and modifying the PR possibly at length, then just let me know and I may be able to look into implementing this myself. But if you'd rather be involved and have your name on the commits, then let's continue adapting this PR.

Some very good points, documentation isn’t my one of my strengths, but I’ll try and answer your questions over the next few days.
One thing I can say about temp tables in the config file.  I added the temp table load to sqlclient because I was using it for an etl process for energy data.  Currently that project has 516 different temp tables so adding that all that into the config file could make it huge and unmanageable.
I also like to have the create table script and exec script to hand so I can easily edit both in sql management studio.
The one reason I was on this project so quick is because the TypeProvider for the etl project is struggling so many thanks for your brilliant work.

Currently that project has 516 different temp tables so adding that all that into the config file could make it huge and unmanageable.

Is there any reason why you can't use user-defined table types?

You also have sql primary key, clustered indexes and vast array of option on a temp-table which could be hard to add config values for.

I was thinking you could just have the entire definition, primary keys and all.
In any case, I see your point. Perhaps both approaches can be supported - tempTableDef for a given parameter can either be a path to an SQL file with the definition, or the inlined definition itself. That part should be trivial, at least. (If valid file path and file exists, load from file, otherwise use string as-is.)

I'll do some research on temp tables in the coming days. I've never used them apart from as an ad-hoc replacement for user-defined table types in FSharp.Data.SqlClient. So it is possible I have a somewhat twisted view of what temp tables are and how they are used.

After doing a bit more research and looking at how temp tables are used, as well as some pitfalls regarding which scope they're available in, I am perhaps thinking that the best and most flexible option is to require users to have temp table definitions in SQL files (meaning we can generate one temp table helper type per file), and then have the API allow users to:

initiate a connection
Create/fill any necessary temp tables using that connection
call the sproc/script that uses the temp table

Something like this:

let getUser (connStr: string) (UserId userId) : Async<User option> =
  async {
    use conn = new SqlConnection()
    do! conn.OpenAsync() |> Async.AwaitTask

    do!
      TempTables.MyTempTable
        .WithConnection(conn)
        // DTO variant
        .AsyncCreateAndLoad(rows = myData |> List.map TempTables.MyTempTable.createRow)
        // Parameter variant
        .AsyncCreateAndLoad(
          rows = (
            myData |> List.map (fun x ->
              TempTables.MyTempTable.createRow(
                col1 = x.Col1,
                col2 = x.Col2
              )
          )
        )

    return!
      Scripts.SomethingThatUsesTempTable
        .WithConnection(conn)
        .WithParameters(..)
        .AsyncExecute()
  }

This is just a draft. One caveat is that nothing requires you to create/define the temp table before calling scripts/procedures that use it.
However, some benefits are:

The user is free to load as many temp tables as they want when they want
The API is orthogonal to the current features
We avoid more complicated connection handling inside Facil

I will work a bit more on the API design and see if there is an elegant way to make it safer (i.e., forcing users to load temp tables as part of the parameter list, just like with TVPs).

On second thought, I think perhaps I would prefer (as I previously mentioned) an API that mirrors the current TVP functionality. Something like this:
MyScript
  .WithConnection(connStr)
  .WithParameters(
    tempTable1 = [TempTables.MyTempTable1.create(Foo = 1)],
    tempTable2 = [TempTables.MyTempTable2.create (Foo = 1, Bar = "test")]
  )

This would require the following:

Detect references to temp tables in scripts/procedures
In facil.yaml, allow the user to configure parameters with the same name as the temp table - most importantly, allow pointing to the SQL file that contains the temp table definition (we can then use the path/filename to generate the proper module/class structure, just like with scripts; if we allow inlining the definition, we wouldn't know where to put the table type or what to call it, though perhaps that can be specified by the user)
At build-time, detect the temp table schema and generate a class for the temp table whose API mirrors that of the table type classes
At runtime, we can't use the same internals as for TVPs; instead, have the script/proc helpers define both async (unit -> Task) and sync (unit -> unit) functions that can be passed to the C# internals, and have them run those functions to create/load the temp tables after opening the connection but before executing the query/command

We currently use temp table in the SqlClient to stream data from one database to another.  I cannot change the schema of the target database which is why I use temp table not table type parameters.
I think I can change my code todo the following and stick to the other connection requirements such as keeping things in the C# internals
    scripts:

      - include: "**/*.sql"
        except: "**/SkipThis.sql"

      - for: SQL/Script1.sql
        params:
          col1:
            tempTable: "CREATE TABLE #Temp(Id int, [Name] NVARCHAR(100))"

tempTable could also be a filename. I'm not 100% sure about yaml so I don't know if the format is correct

  let externalData =
    seq {
      1, "user"
    }

  let mapped =
    externalData
    |> Seq.map(fun (id, name) ->
      {| Id = id; Name = name |}
    )

  let result =
    DbGen.Scripts.SQL.NormalParams
      .WithConnection("")
      .WithParameters(
        {| SomeValue = 1
           Data = mapped |})
      .Execute()

This would be a really help me slot this into existing code.

Just want to let you know that I'm actively working on this now. I hope to have something working during the weekend, but no promises.

@cmeeren I've had a go at this myself and I've got the code to match what I said above:
      let data =
        seq {
          {| Id = 1; Name = "name" |}
        }

      let res =
        DbGen.Scripts.SQL.TempTable
          .WithConnection(Config.connStr)
          .WithParameters({| data = data |})
          .Execute()
        |> Seq.toList

I still haven't done the non-dto WithParameters correctly, it's hacked in for now.

Thanks. Don't worry about it. I'm close with an implementation that works with both DTO and non-DTO, and uses somewhat different internals/config.

Non-DTO are in now in. Its become quite light touch PR - I'm managed to squeeze it in without changing too much.
@cmeeren It's here if you need it, could save you a bit of time.

Hi,
Support for temp tables are now on master. Once the CI build completes, there will be a nupkg here.
Are you able to give it a try? I'll wait with releasing this until you have provided feedback. It's well tested and works, and I think you'll find it satisfies your requirements, but I'd like to be sure and hear your opinion before releasing.

Note that I just updated the readme with info on temp tables.
Also, I overlooked a compile error; the nupkg will be available here.

By the way, thank you so much for this PR. I have credited you in the changelog and the commit (4a300f38f10d3aaa02ef8b7f5dc785bfba80f3a2).
Even though I did not merge this PR, the work you did here definitely helped me pin down some critical implementation details and sped things up quite a bit. The reason I implemented it myself, was a combination of the following: 1) This is a large and non-trivial feature, 2) I had some clear opinions on the implementation details, 3) I have limited resources for OSS work at the moment, and 4) guiding this PR to match my preferred implementation would take a lot longer than simply doing it myself.
Thanks again for your work, and let me know if the current implementation works for you.

@cmeeren it's looking really good, I really like the extra config options.
I didn't notice one thing, if you changed the render to it output this:
        member inline this.WithParameters(dto: ^a) =
          let sqlParams =
            [|
            |]
          let tempTableData =
            this.CreateTempTableData(
              (^a: (member ``TempTableInlined``: _) dto) |> Seq.map Script1.tempTableInlined.create // Change here
            )
          ``Script1_Executable``(this.connStr, this.conn, this.configureConn, this.userConfigureCmd, sqlParams, tempTableData)

You could cut down the verbose typings at the user side for extra developer happiness 😄
    DbGen.Scripts.SQL.Script1.WithConnection("").WithParameters(
      {| TempTableInlined = [{| Col1 = 1; Col2 = Some "" |} ] |})
      .Execute()

I'll try and add this to a real project tonight and see how it goes.

You could cut down the verbose typings at the user side for extra developer happiness 😄

It is a deliberate design decision on my part to not support recursive records like that for TVPs and temp tables. I could do it, but it would have to be named something other than WithParameter (because it would conflict in overload resolution with the existing DTO WithParameter), and it would make it more complicated regarding adjusting DTO names in the config, and it would mean it's less flexible because currently you can use any create overload to create the temp table or TVP rows.
Furthermore, if you already have the nested record, there's a trivial workaround using anonymous record copy-and-update:
let myNestedRecord = { .. }

let myNestedRecordWithCorrectTempTableTypes =
  {| myNestedRecord with MyTableType = myNestedRecord.MyTableType |> List.map Script1.tempTableInlined.create |}

..
.WithParameters(myNestedRecordWithCorrectTempTableTypes )

This design decision is not set in stone, but I'd like to see how Facil currently feels before potentially changing it.

Thinking about it, it may actually be better to just have the DTO overloads accept nested DTOs. I'll give it some more thought.

Just dropping some of this into a real project I can see you are using c# style ResizeArrays and IEnumerable which comes from the c# library.
I think most f# users would rather see the native f# list and seq than the c# types. For large resizearrays this could dramatical increase the memory needed as it's re-cast into f# list.
Correct me if I’m wrong but are you using the c# project because you of the awaits and tasks.  You may already know but there is a an TaskBuilder which makes working with .net tasks really easy and you wouldn’t need to c# project
Also there is AsyncSeq which could be better?
        asyncSeq {
            let! ct = Async.CancellationToken

            do! LoadTempTablesAsync(existingConn, tempTableData, ct)
            use cmd = existingConn.CreateCommand()
            configureCmd(cmd)
            use! reader = cmd.ExecuteReaderAsync(CommandBehavior.SingleResult, ct) |> Async.AwaitTask

            if reader.HasRows then
                initOrdinals reader

                let rec nextRow () =
                    asyncSeq {
                        let! hasRow = reader.ReadAsync(ct) |> Async.AwaitTask
                        if hasRow then
                            getItem(reader)
                            return nextRow ()
                    }

                return nextRow ()

        }

All the decisions you mention are very deliberate.

ResizeArrays and IEnumerable which comes from the c# library.

I use ResizeArray and C#/Task because of performance. AFAIK ResizeArray is the most effective solution for reading a number of rows into a data structure. I deliberately chose to surface this directly and not convert, because uses should control this themselves. I agree that F# users normally want list, but that's just a Seq.toList away, and thus not a problem. You'd have to do this if Facil returned seq anyway. It's no different than FSharp.Data.SqlClient; it returns seq where you have to do Seq.toList after calling Execute.
I use C#'s native async/await rather than TaskBuilder because of performance as well as not taking unneeded dependencies.
Using AsyncSeq as the inner read loop is out of the question due to performance (and it's an unneeded dependency). Note that you can use AsyncSeq on your end to lazily evaluate the results if you use AsyncLazyAexecute, which returns IAsyncEnumerable.

For large resizearrays this could dramatical increase the memory needed as it's re-cast into f# list.

AFAIK this is not true. To build up an F# list most efficiently, you'd have to prepend each item, and then reverse it, creating a new list. That would first of all effectively be a copying of the list, and second of all it would cause massively more allocations (one per item) compared to ResizeArray.
Note that I haven't benchmarked anything (primarily because as a general library I know nothing of the workloads users will have); this is just going by intuition. I've given it quite a bit of thought, but let me know if you think I'm in the wrong in any of the above.

Sorry, I should have put this as an issue/suggestion rather than a comment on this PR.
I agree with points you have made on performance on the dotnet side but most of the bottlenecks I've found working with SQL isn't the dotnet side but some IO lock in SQL or some-such.
There is a trade off here with speed and building a toolset that hooks up with other parts of the ecosystem.
Coming from someone who battles with the F# SqlClient everyday I'm hoping your new ace tool will be picked up and used by the community and all the help it brings. Just trying to pre-empt some future - "Why are we using X when we should be using Y" which is at the core of the project.

I see. If you believe any of the points I mentioned in the previous comment are mistaken, please open an issue and we can surely discuss both the public API and implementation details.
I'll add a FAQ entry about ResizeArray.

Thinking about it, it may actually be better to just have the DTO overloads accept nested DTOs. I'll give it some more thought.

I have given this "nested DTO" feature some thought. I see a couple of problems with it:
Overload resolution
Overload resolution doesn't work for the TVP/temp table create methods, so they need to have different names, e.g. create and createFromDto.
Records vs. primitives for single-col TVPs/temp tables
For single-column TVPs/temp tables, it's hard to know whether the user wants to pass a list of record with a single field, or just pass a list of primitive values. Both may be useful in different circumstances.
Ability to drop DTO in config
In the config, one can omit DTO overloads for any table type. This would break if the table type is used in a procedure/script where the DTO overload is not omitted. I prefer keeping such interactions to a minimum to avoid confusion.
Makes it harder for the user to choose
Since the user must currently call the relevant create method, they have full freedom with respect to which overload they use. With nested records, we take away that freedom (unless we make it possible to both keep the current behavior and use the other behavior, adding complexity and possible confusion).
Less orthogonal API
Currently, since the proc/script DTO overloads accept the concrete TVP/temp table type, it works equally well regardless of how the user creates the TVP/temp table rows. If we support nested DTOs, we lock it down to a single way of creating the TVPs/temp tables. While it is theoretically possible to add multiple "nested DTO" overloads, it quickly becomes confusing and downright unmanageable; imagine if we add more create methods to TVPs and temp tables for e.g. different member casing. You'd quickly get a combinatorial explosion of variants, and it would be infeasible to account for all combinations of all TVPs/temp tables in a procedure/script.

The above points, together with the fact that calling the relevant create method is currently very easy (including using anonymous record copy-and-update for existing DTOs in whatever form), I believe the best option is to keep the current behavior.

By the way, please let me know if you (or anyone else reading this) think the temp table feature is ready to be released on NuGet (i.e., there are no immediate breaking changes that needs to be made to this feature
). I'll wait for your go-ahead on this one.

@cmeeren I'm just trying this against a smaller project that uses bulk load/merge statement and raised a issue: https://github.com/cmeeren/Facil/issues/4
It's not todo with the temp tables but I can't generate the file at the moment.

Published in 0.1.3.

Published in 0.1.3.


Receiving error when trying to start a tunnel

Hi, I'm receiving this error when trying to start a tunnel: Error: spawn Unknown system error -8
I choose CloudFlare login. It states I'm logged in.
I have tried a few different ways regarding the subdomain. I made up a subdomain. Same error. I configured the subdomain in ZeroTrust and still same error.
I looked for a spot to enter my API key but could find it. When I choose CloudFlare login it just gives a popup stating I'm logged in. But never redirects me to a browser log-in page of CloudFlare or for my API key.
I've also tried logging out and back in too.
Extension version: v0.3.4
System: MacBookPro Version 12.6.8
VSCode: Version: 1.81.1 (Universal)
Commit: 6c3e3dba23e8fadc360aed75ce363ba185c49794
Date: 2023-08-09T22:20:33.924Z
Electron: 22.3.18
ElectronBuildId: 22689846
Chromium: 108.0.5359.215
Node.js: 16.17.1
V8: <IP_ADDRESS>-electron.0
OS: Darwin x64 21.6.0

It just doesn't support macOs -- see here. It downloads just Windows / Linux binaries.

Ahhh, well that sucks :) But...since I wrote this, I moved over to Windows11. I'll give it a try now.
Thanks for taking the time to look into this.


Packaging for Homebrew

I'd like to make this available on the OS X package manager Homebrew. To do so I need a release to point at. Any chance you can tag a release?

Added a new release 3.4 check it out here https://github.com/AnimeshShaw/Hash-Algorithm-Identifier/releases/tag/v3.4-beta.1
Closed.


Forge 1.19.2 / Lootr <IP_ADDRESS> - Crash When Opening Chest

Having an issue with Lootr causing lag and eventually crashing the server via watchdog. It has so far only occurred with underwater chests.
I believe the actual issue has something to do with an item because a chest that one player has already opened can be opened by another player and then cause the lag/crash. I've read #100 and #152 and believe my issue may be similar, but I can't read the log well enough to be able to tell. I do not have Terralith but I have quite a few mods that generate structures, so maybe one of them is the culprit?
Hoping this isn't a duplicate but if it is then I apologize!
Also curious about this issue posted on a FTB project where a dev says that the issue is fixed in the upcoming update to Lootr, but this was posted five days after the latest release for 1.19.2. Is there a new version somewhere that fixes this?
Here's the crash log, latest, and debug.

Issue is vanilla Minecraft. For anyone else finding this, the fix is to use a datapack that replaces buried treasure maps.

I'd also suggest checking out Async Locater as another solution to this bug.


Configuration of voice

Suggest to expose a config setting to let user choose which voice to use. like premade vocie (Elli/Adam/Bella) in ElevanLabs.
The voice in author's demo works perfectly, however, when I deployed to my server, the voice is not nature and smooth. It speeks like robot.
Is a quick way to config which voice to use?

done: https://github.com/lspahija/AIUI/commit/99ddeff9d7981d576e9869aba914b0ba417c0600


ssh connection timeout on vagrant up

$ vagrant up st2 --provider=virtualbox

Bringing machine 'st2' up with 'virtualbox' provider...
==> st2: Importing base box 'stackstorm/st2express'...
==> st2: Matching MAC address for NAT networking...
==> st2: Checking if box 'stackstorm/st2express' is up to date...
==> st2: Setting the name of the VM: st2workroom_st2_1447654085174_26976
==> st2: Clearing any previously set network interfaces...
==> st2: Preparing network interfaces based on configuration...
    st2: Adapter 1: nat
    st2: Adapter 2: hostonly
==> st2: Forwarding ports...
    st2: 22 => 2222 (adapter 1)
==> st2: Running 'pre-boot' VM customizations...
==> st2: Booting VM...
==> st2: Waiting for machine to boot. This may take a few minutes...
    st2: SSH address: <IP_ADDRESS>:2222
    st2: SSH username: vagrant
    st2: SSH auth method: private key
    st2: Warning: Connection timeout. Retrying...
    st2: Warning: Connection timeout. Retrying...
    st2: Warning: Connection timeout. Retrying...
    st2: Warning: Connection timeout. Retrying...
    st2: Warning: Connection timeout. Retrying...

Vagrant version: 1.7.4
VirtualBox version: 5.0.10r104061
Host: Ubuntu 14.04
Is there any change that needs to be done to Vagrantfile to enable the ssh connectivity?

@mukulashokjoshi Sorry you're having issues!
Typically, you should have to do nothing except type the command you did, and it should come up without problem.
I've tried to replicate your issue unsuccessfully. Let's try a few things!

What version of the stackstorm/st2express VM do you currently have installed? You can find this with vagrant box list.

There is a known issue with v60, and it was revoked. If you have v60, go ahead and delete that box and use v59

It might be that for some very odd reason, the node is waiting on input. I have seen this before with other boxes, so it's worth a shot attempting to take a look here as well. Do the following:

While your VM is booting, in a separate terminal window, just find out the id of the running machine.
vboxmanage list runningvms

This will result in something like this:
"projects_1234567890" {5cxxxx-cxxx-4xxx-8xxx-5xxxxxxxxxx}

Quite often, the VM is simply waiting for you to select an option in the bootloader. You can send the appropriate keycode (in the case, Enter) to the vm with controlvm:
vboxmanage controlvm projects_1234567890 keyboardputscancode 1c

If neither of these work, drop a note in here with the specs of the host machine, and we'll keep digging!

@jfryman Thanks for taking time out to reply to this
Suggestion 1: output of "vagrant box list" is - stackstorm/st2express (virtualbox, 59)
Suggestion 2: No luck
System information from "inxi -Fxz" in "sysinfo.txt" attached
sysinfo.txt
Debug1.txt  from running "vagrant up st2 --provider=virtualbox --debug 2>&1 | tee debug1.log" attached
debug1.txt
Debug2.txt from running "vagrant ssh st2 --debug 2>&1 | tee debug2.log" attached
debug2.txt
I have also generated private SSH keys by following instructions from this URL: http://www.productiveminds.com/blog/vagrant-ssh-authentication-how-to-successfully-login-into-vm-box-using-vagrant-up/. But in absence of complete understanding of the setup, have not been able to make the changes for the "private key path". Adding anything like "config.vm." or "config.ssh." in Vagrantfile results in an error. Some of the ssh stuff is there in files like "st2-atlas.json" and "workroom.yaml". If possible, some pointers on how to make changes would be useful.
Thanks & Regards

@mukulashokjoshi I spent a considerable amount of time yesterday trying to find something that is causing issues. I'm still digging, but I do want to get you unblocked.
First, where do you add things:
https://github.com/StackStorm/st2workroom/blob/master/Vagrantfile#L139
Anywhere inside the scope of this block is safe to add attributes to the machine. Try seeing if you can increase the boot timeout, or even the SSH key management. The private key on the box is in fact the master key shipped with most boxes, so I'm not sure if that is the underlying issue. However, would love to hear your findings.
I might also add the following to the Vagrantfile just to get a GUI and see what's going on. Insert a line around https://github.com/StackStorm/st2workroom/blob/master/Vagrantfile#L156, and add the following inside the n.vm.provider 'virtualbox' do |virtualbox| block.
  virtualbox.gui = true

Finally, another thing to consider is to just spin up a fresh VM in your favorite way (ignore StackStorm st2workroom) and instead use the installer script. Take a look at http://docs.stackstorm.com/install/all_in_one.html#bring-your-own-box.
Let us know how it goes, we'll get you up and running!

@jfryman Thanks for your time on this
I have started the "all in one" installation (have obfuscated the actual proxy URLs below):
Initially did not provide the HTTPS proxy for the root user. There is a HTTPS proxy configured for a normal user, but the root does not pick it up. Tried to use various mechanism to set the proxy for root (/etc/environment, /root/.profile, /etc/bash.bashrc with sudo bash), but these did not work. So passed the proxy in the command itself:
curl -sSL http://stackstorm.com/install.sh | sudo env https_proxy='https://..' sh
This solved the initial issue (not able to access Github over HTTPS), but failed later on trying to use HTTPS proxy in place of required HTTP proxy:
Error: Could not set 'present' on ensure: Non-HTTP proxy URI: https://... at 88:/opt/puppet/shared/apt/manifests/key.pp
Error: Could not set 'present' on ensure: Non-HTTP proxy URI: https://... at 88:/opt/puppet/shared/apt/manifests/key.pp
Wrapped exception:
Non-HTTP proxy URI: https://...
Error: /Stage[main]/Nodejs::Repo::Nodesource::Apt/Apt::Source[nodesource]/Apt::Key[Add key: 9FD3B784BC1C6FC31A8A0A1C1655A0AB68576280 from Apt::Source nodesource]/Apt_key[Add key: 9FD3B784BC1C6FC31A8A0A1C1655A0AB68576280 from Apt::Source nodesource]/ensure: change from absent to present failed: Could not set 'present' on ensure: Non-HTTP proxy URI: https://... at 88:/opt/puppet/shared/apt/manifests/key.pp
So then added the HTTP proxy also to the command and did a rerun:
curl -sSL http://stackstorm.com/install.sh | sudo env http_proxy='http://...' https_proxy='https://...' sh
But unfortunately, it fails with the same error. Is the proxy URL stored somewhere?
Is there a way to do a complete clean-up and re-start?
Tried the "update-system" too (with "sudo env http_proxy='http://...' https_proxy='https://...' sh"), but this also fails with the same error
Did a grep in the /opt to see if the proxy gets stored somewhere in the install, but could not find any trace
Thanks

@mukulashokjoshi OK! Well, good news is that we both know what causes the issue with the proxy and apt, have a fix underway, and have a workaround right now.
Take a look at https://stackstorm.reamaze.com/kb/installation/connection-reset-by-peer-trying-to-download-openpgp-keys (we're beta testing some KB tools, so this may move... but the instructions are solid). This should get you going, and I'll get a fix in shortly.

@jfryman Thanks
Update on the "all in one" installation:
As per your recommendation, used the workaround in the #269 issue and manually updated the keys. There was no need to enable the TCP port, as use of the port 80 sufficed as shown below:
apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --keyserver-options http_proxy='http://HTTP_PROXY' --recv-keys KEY_ID

But there was another error which resulted in failure related to network timed out:
Notice: /Stage[main]/Profile::Rabbitmq/Docker::Image[rabbitmq]/Exec[docker pull rabbitmq]/returns: Pulling repository docker.io/library/rabbitmq
Notice: /Stage[main]/Profile::Rabbitmq/Docker::Image[rabbitmq]/Exec[docker pull rabbitmq]/returns: Network timed out while trying to connect to https://index.docker.io/v1/repositories/library/rabbitmq/images. You may want to check your internet connection or if you are behind a proxy.
Error: docker pull rabbitmq returned 1 instead of one of [0]
Error: /Stage[main]/Profile::Rabbitmq/Docker::Image[rabbitmq]/Exec[docker pull rabbitmq]/returns: change from notrun to 0 failed: docker pull rabbitmq returned 1 instead of one of [0]
Notice: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/Exec[/bin/sh /etc/init.d/docker-rabbitmq stop]: Dependency Exec[docker pull rabbitmq] has failures: true
Warning: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/Exec[/bin/sh /etc/init.d/docker-rabbitmq stop]: Skipping because of failed dependencies
Notice: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/File[/var/run/docker-rabbitmq.cid]: Dependency Exec[docker pull rabbitmq] has failures: true
Warning: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/File[/var/run/docker-rabbitmq.cid]: Skipping because of failed dependencies
Notice: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/File[/etc/init.d/docker-rabbitmq]: Dependency Exec[docker pull rabbitmq] has failures: true
Warning: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/File[/etc/init.d/docker-rabbitmq]: Skipping because of failed dependencies
Notice: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/Service[docker-rabbitmq]: Dependency Exec[docker pull rabbitmq] has failures: true
Warning: /Stage[main]/Profile::Rabbitmq/Docker::Run[rabbitmq]/Service[docker-rabbitmq]: Skipping because of failed dependencies
Notice: /Stage[main]/Profile::Mongodb/Docker::Image[mongo]/Exec[docker pull mongo:2.4.14]/returns: Pulling repository docker.io/library/mongo
Notice: /Stage[main]/Profile::Mongodb/Docker::Image[mongo]/Exec[docker pull mongo:2.4.14]/returns: Network timed out while trying to connect to https://index.docker.io/v1/repositories/library/mongo/images. You may want to check your internet connection or if you are behind a proxy.
Error: docker pull mongo:2.4.14 returned 1 instead of one of [0]
Error: /Stage[main]/Profile::Mongodb/Docker::Image[mongo]/Exec[docker pull mongo:2.4.14]/returns: change from notrun to 0 failed: docker pull mongo:2.4.14 returned 1 instead of one of [0]
Notice: /Stage[main]/Profile::Mongodb/Exec[create mongodb data container]: Dependency Exec[docker pull mongo:2.4.14] has failures: true
Warning: /Stage[main]/Profile::Mongodb/Exec[create mongodb data container]: Skipping because of failed dependencies

Update on the ssh connection timeout:
As part of various workarounds to overcome the ssh connection timeout, one is related to enabling Virtualisation in BIOS. Refer: http://stackoverflow.com/questions/22575261/vagrant-stuck-connection-timeout-retrying & https://github.com/Varying-Vagrant-Vagrants/VVV/issues/375
So a separate box, recreated the issue and then checked the Virtualisation (Intel) in the BIOS (UEFI). Here it was observed that Virtualisation was not enabled. After enabling Virtualisation, re-ran the vagrant up st2 and script was able to connect to VM via SSH and complete the provisioning. There were still some timeouts while updating some of the 'packs', but this did not result in a fatal error and finally the ST2 OK message was displayed. This box has Linux Mint 17.2 which has Ubuntu 14.04 underlying.
Will have to see how to enable Virtualisation for the original box where we saw the error, which only has remote SSH access

@mukulashokjoshi We've identified several parts of the installer that needs additional :heart: with regards to Proxies. We're currently taking a look, and trying to get a better story here.
I will keep this issue updated as we make additional movement. Apologies for the inconveniences, but we'll get you taken care of!

@jfryman Thanks
Update-2 on the "all in one" installation:
We have been doing some workarounds so as to see if we can move forward with the install.
Workaround-1 : Enabling the docker load
We decided to “docker pull, save" on a separate box, then FTPed the docker tar image to remote server and then did a "docker load" of the tar files. This Stackoverflow comment was useful: http://stackoverflow.com/questions/22381442/pulling-docker-images
This was followed for rabbitmq & mongo:2.4.14, for which there were "network timed out" errors
Re-ran the ST2 install with "/opt/puppet/script/bootstrap-st2" which resulted in a another error:
Error: Could not start Service[docker-mongo]: Execution of '/etc/init.d/docker-mongo start' returned 1: Error: No such image or container: mongo
Starting docker-mongo:  Unable to find image 'mongo:latest' locally
Pulling repository docker.io/library/mongo
Network timed out while trying to connect to https://index.docker.io/v1/repositories/library/mongo/images. You may want to check your internet connection or if you are behind a proxy.

Initially error was for "mongo:2.4.14" & "rabbitmq", when these were loaded, then error was for "mongo:latest". Loaded the "mongo:latest" docker image following procedure as above.
Workaround-2 : Enabling the docker proxy
The proxy to be used by docker was "hard coded" in this file:
/opt/puppet/.tmp/librarian/cache/source/puppet/forge/forgeapi_puppetlabs_com/garethr-docker/4.1.1/docker/templates/etc/default/docker.erb
Re-ran the ST2 install, which resulted in some more errors:
Error: st2 run packs.install packs=libcloud    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[libcloud]/Exec[install-st2-pack-libcloud]/returns: change from notrun to 0 failed: st2 run packs.install packs=libcloud    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[jira]/Exec[install-st2-pack-jira]/returns: 2015-11-30 10:56:57,490  WARNING - Auth API server is not available, skipping authentication.
Notice: /Stage[main]/St2::Packs/St2::Pack[jira]/Exec[install-st2-pack-jira]/returns: ERROR: HTTPSConnectionPool(host='<IP_ADDRESS>', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=jira    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[jira]/Exec[install-st2-pack-jira]/returns: change from notrun to 0 failed: st2 run packs.install packs=jira    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[openstack]/Exec[install-st2-pack-openstack]/returns: 2015-11-30 10:57:15,235  WARNING - Auth API server is not available, skipping authentication.
Notice: /Stage[main]/St2::Packs/St2::Pack[openstack]/Exec[install-st2-pack-openstack]/returns: ERROR: HTTPSConnectionPool(host='<IP_ADDRESS>', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=openstack    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[openstack]/Exec[install-st2-pack-openstack]/returns: change from notrun to 0 failed: st2 run packs.install packs=openstack    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[aws]/Exec[install-st2-pack-aws]/returns: 2015-11-30 10:57:32,867  WARNING - Auth API server is not available, skipping authentication.
Notice: /Stage[main]/St2::Packs/St2::Pack[aws]/Exec[install-st2-pack-aws]/returns: ERROR: HTTPSConnectionPool(host='<IP_ADDRESS>', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=aws    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[aws]/Exec[install-st2-pack-aws]/returns: change from notrun to 0 failed: st2 run packs.install packs=aws    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[twitter]/Exec[install-st2-pack-twitter]/returns: 2015-11-30 10:57:50,492  WARNING - Auth API server is not available, skipping authentication.
Notice: /Stage[main]/St2::Packs/St2::Pack[twitter]/Exec[install-st2-pack-twitter]/returns: ERROR: HTTPSConnectionPool(host='<IP_ADDRESS>', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=twitter    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[twitter]/Exec[install-st2-pack-twitter]/returns: change from notrun to 0 failed: st2 run packs.install packs=twitter    returned 1 instead of one of [0]

And auth related:
2015-11-30 10:58:47,045  WARNING - Auth API server is not available, skipping authentication.
ERROR: HTTPSConnectionPool(host=' . . . ', port=9101): Max retries exceeded with url: /actions/core.local (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))

But were able to get the ST2 OK message
The setup was then accessed at: https://BOX_IP/setup
The basic setup was done and at the end of the setup, the installation completion was triggered which resulted in further errors (there is github error related to proxy amongst others) as noted in this log:
Install_Errors.txt
On accessing the https://BOX_IP, also got "invalid or missing credentials" when trying to login as "admin" which was configured during setup process

@mukulashokjoshi It looks like you're so close!
First, I really appreciate the investigation you're doing. We have a proxy server lab now setup on our end, so we'll officially certify support with Proxies very soon. Your data here is most helpful! :bow:
In the short term, I think you have the bits you need... and now you've run into this error.
https://docs.stackstorm.com/install/all_in_one.html#errors-on-connection
Try adding the correct ethernet adapter to the answers.yaml file as indicated in the doc. Also, be careful when copy/pasting the text from the help document, as it has UTF-8 quotation marks, and that does not play well with Puppet.
Let us know how it goes!

@jfryman Thanks
Will go through the new details mentioned by you
Update-3 on the "all in one" installation:
Executing "update-system" resulted in some certificate errors:
Error: /Stage[main]/Profile::St2server/Vcsrepo[/etc/st2installer]: Could not evaluate: Execution of '/usr/bin/git fetch origin' returned 128: fatal: unable to access 'https://github.com/stackstorm/st2installer/': Problem with the SSL CA cert (path? access rights?)
Error: /Stage[main]/St2::Profile::Mistral/Vcsrepo[/opt/openstack/mistral]: Could not evaluate: Execution of '/usr/bin/git fetch origin' returned 128: fatal: unable to access 'https://github.com/StackStorm/mistral.git/': Problem with the SSL CA cert (path? access rights?)
Error: /Stage[main]/St2::Profile::Mistral/Vcsrepo[/etc/mistral/actions/st2mistral]: Could not evaluate: Execution of '/usr/bin/git fetch origin' returned 128: fatal: unable to access 'https://github.com/StackStorm/st2mistral.git/': Problem with the SSL CA cert (path? access rights?)
Notice: /Stage[main]/Profile::St2server/Users[root_cli]/Exec[Setting root_cli password]/returns: executed successfully
Error: /Stage[main]/Profile::St2server/Ca_cert::Ca[stackstorm-ca]/File[stackstorm-ca.crt]: Could not evaluate: Could not retrieve file metadata for : Cannot find file: Invalid mount ''
Notice: /Stage[main]/Ca_cert::Update/Exec[ca_cert_update]: Dependency File[stackstorm-ca.crt] has failures: true
Warning: /Stage[main]/Ca_cert::Update/Exec[ca_cert_update]: Skipping because of failed dependencies
Notice: /Stage[main]/Profile::St2server/Ca_cert::Ca[stackstorm-ca]/Anchor[ca_cert::ca::stackstorm-ca]: Dependency File[stackstorm-ca.crt] has failures: true
Warning: /Stage[main]/Profile::St2server/Ca_cert::Ca[stackstorm-ca]/Anchor[ca_cert::ca::stackstorm-ca]: Skipping because of failed dependencies

Workaround-1: Enabling the ST2 services
By default it is observed that the services are not running. So we enabled the services with st2ctl:
usage: st2ctl {restart-component}
positional arguments:
  component           Name of the st2 service to restart.
                      st2actionrunner st2api st2auth st2sensorcontainer st2rulesengine st2web mistral st2resultstracker st2notifier

Workaround-2: Enabling the CA certificates
Some details on certificates are mentioned here: https://github.com/StackStorm/st2installer/issues/29
So the certificate from https://BOX_IP/ssl/st2_root_ca.cer was downloaded and installed into the Ubuntu certificatte store as per this URL: http://superuser.com/questions/437330/how-do-you-add-a-certificate-authority-ca-to-ubuntu
Not sure if this is correct.
Workaround-3: Enabling the API URL
If the hostname is not provided, then by default the hostname is taken from the IP address as ip-NET1-NET2-NET3-HOST
The api_url in the st2.conf was changed to:
# Base URL to the API endpoint excluding the version (e.g. http://myhost.net:9101/)
api_url =https://ip-NET1-NET2-NET3-HOST:9101

After this certificate errors were not observed
Workaround-4: Enabling npm proxies
Some npm errors were observed related to proxies, so npm proxies were enabled with these:
npm config set proxy http://PROXY_IP:PORT
npm config set https-proxy https://PROXY_IP:PORT

Workaround-5: Enabling /setup to run multiple times
Since we were doing changes cyclically, we need to run https://BOX_IP/setup multiple times. But it was observed that this was not happening. It was observed that the install logs were stored in /tmp/st2installer.log and there was a related lock file /tmp/st2installer_lock. Renaming these, enabled the /setup to be run again
Workaround-6: Enabling authentication
By default the authentication is set to pam in the st2.conf as follows:
[auth]
host = <IP_ADDRESS>
port = 9100
use_ssl = False
debug = True
enable = True
logging = /etc/st2auth/syslog.conf

mode = standalone

# Note: Settings bellow are only used in "standalone" mode
backend = pam
backend_kwargs =

This was changed to flat_file as follows:
[auth]
host = <IP_ADDRESS>
port = 9100
use_ssl = False
debug = True
enable = True
logging = /etc/st2auth/syslog.conf

mode = standalone

# Note: Settings bellow are only used in "standalone" mode
backend = flat_file
backend_kwargs = {"file_path": "/etc/st2/.htpasswd"}

The password for the admin user was generated as follows:
htpasswd /etc/st2/.htpasswd <username> <password>

With this change the authentication worked and we were able to access the StackStorm HISTORY, ACTION and RULES!
Using Mongo DB for authentication
We came across this module: https://github.com/StackStorm/st2-auth-backend-mongodb/blob/master/README.md
This enables use of Mongo DB for authentication
It will be useful to get some pointers on how to integrate this module into the main build
Also it will be useful to some pointers on how to do the build for complete ST2
Somewhere have read that ST2 can be used to do build for ST2. Again will be useful to get some leads on this.
Errors while installing packs
Notice: /Stage[main]/St2::Packs/St2::Pack[hubot]/Exec[install-st2-pack-hubot]/returns: ERROR: HTTPSConnectionPool(host='BOX_IP', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=hubot    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[hubot]/Exec[install-st2-pack-hubot]/returns: change from notrun to 0 failed: st2 run packs.install packs=hubot    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[hubot]/File[/opt/stackstorm/packs/hubot/config.yaml]: Dependency Exec[install-st2-pack-hubot] has failures: true
Warning: /Stage[main]/St2::Packs/St2::Pack[hubot]/File[/opt/stackstorm/packs/hubot/config.yaml]: Skipping because of failed dependencies
Notice: /Stage[main]/St2::Packs/St2::Pack[st2]/Exec[install-st2-pack-st2]/returns: ERROR: HTTPSConnectionPool(host='BOX_IP', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=st2    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[st2]/Exec[install-st2-pack-st2]/returns: change from notrun to 0 failed: st2 run packs.install packs=st2    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[puppet]/Exec[install-st2-pack-puppet]/returns: ERROR: HTTPSConnectionPool(host='BOX_IP', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=puppet    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[puppet]/Exec[install-st2-pack-puppet]/returns: change from notrun to 0 failed: st2 run packs.install packs=puppet    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[github]/Exec[install-st2-pack-github]/returns: ERROR: HTTPSConnectionPool(host='BOX_IP', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=github    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[github]/Exec[install-st2-pack-github]/returns: change from notrun to 0 failed: st2 run packs.install packs=github    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[victorops]/Exec[install-st2-pack-victorops]/returns: ERROR: HTTPSConnectionPool(host='BOX_IP', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=victorops    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[victorops]/Exec[install-st2-pack-victorops]/returns: change from notrun to 0 failed: st2 run packs.install packs=victorops    returned 1 instead of one of [0]
Notice: /Stage[main]/St2::Packs/St2::Pack[sensu]/Exec[install-st2-pack-sensu]/returns: ERROR: HTTPSConnectionPool(host='BOX_IP', port=9101): Max retries exceeded with url: /actions/packs.install (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Tunnel or SSL Forbidden',)))
Error: st2 run packs.install packs=sensu    returned 1 instead of one of [0]
Error: /Stage[main]/St2::Packs/St2::Pack[sensu]/Exec[install-st2-pack-sensu]/returns: change from notrun to 0 failed: st2 run packs.install packs=sensu    returned 1 instead of one of [0]

Any pointers on adding packs from st2contrib will also be useful

@jfryman
Update-4 on the "all in one" installation:
Workaround-1: Enabling packs install
In light of the issues faced with the packs install, which times out while trying connect to proxy, we tried to independently load the Git repo and then run the packs install. So a git clone was done and then tried to install the pack from the local git repo:
st2  run packs.install packs=hubot repo_url=/root/st2contrib.git

This did not work completely
So tried to do some more variations with the st2 run command:
st2  run -e packs.setup_virtualenv packs=hubot

This seems to work consistently and packs can be installed with the pack being downloaded from the net. The -e param seems to pick up the environment details for the proxy to work
Now we have some of the basic packs installed
We will try to do enable some automations
Ofcourse knowledge of complete build will be useful going forward
Thanks

@jfryman
The output of st2ctl status is:
##### st2 components status #####
st2actionrunner PID: 22221
st2actionrunner PID: 22222
st2actionrunner PID: 22223
st2actionrunner PID: 22224
st2actionrunner PID: 22225
st2actionrunner PID: 22226
st2actionrunner PID: 22227
st2actionrunner PID: 22228
st2actionrunner PID: 22229
st2api PID: 620
st2api PID: 22238
st2auth PID: 22245
st2sensorcontainer PID: 22259
st2rulesengine PID: 22270
st2web is not running.
mistral PID: 22289
mistral PID: 22291
st2resultstracker PID: 22317
st2notifier PID: 22330

And output of st2ctl stop is:
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.510" (uid=1000 pid=29830 comm="stop st2actionrunner ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.512" (uid=1000 pid=29836 comm="stop st2api ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.514" (uid=1000 pid=29842 comm="stop st2auth ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.516" (uid=1000 pid=29848 comm="stop st2sensorcontainer ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.518" (uid=1000 pid=29854 comm="stop st2rulesengine ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.520" (uid=1000 pid=29860 comm="stop st2web ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.522" (uid=1000 pid=29866 comm="stop mistral ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.524" (uid=1000 pid=29872 comm="stop st2resultstracker ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")
stop: Rejected send message, 1 matched rules; type="method_call", sender=":1.526" (uid=1000 pid=29878 comm="stop st2notifier ") interface="com.ubuntu.Upstart0_6.Job" member="Stop" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init")

Any clues as to why the st2ctl stop call is rejected?
Thanks

@mukulashokjoshi are you running that command as root or as a user that has root privileges? I have seen that error when running as an unprivileged user.

@jfryman
Thanks for the clarification
My mistake
sudo st2ctl stop works
##### st2 components status #####
st2actionrunner is not running.
st2api is not running.
st2auth is not running.
st2sensorcontainer is not running.
st2rulesengine is not running.
st2web is not running.
mistral is not running.
st2resultstracker is not running.
st2notifier is not running.

https://stackstorm.slack.com/archives/support/p1451931085001030


Adding 1inch to Exchanges

1inch is a DEX aggregator that worked to optimize rETH swaps by directly integrating the mint/burn contracts. It currently offers the best rate on large rETH swaps.

Thanks for adding this!


Export CSV doesn't show full list; pagination is not happening

Describe the bug
hey Soon Team,
I have a problem with the 'Export CSV'.
I try to make a download and now i see that the export did not show the whole history (seems like realy old Transactions are deleted after a time and not shown in the export).
-> then i had a look on my old exports to merge them to get a full history. But now its super weird...

This is just one example from a user, there are other users also affected
Expected behavior
Full list of all tx since existence of the account
Desktop (please complete the following information):
Multiple
Smartphone (please complete the following information):
Multiple

As per Taskforce request, adding some comments based on what I think the issue is:

transactions under member profile does not support pagination. It only shows first 50 records. Add it.

@adamunchained I checked and found the member profile does support pagination, eg. in my case there are 4 pages with transactions records:
https://soonaverse.com/member/0x4bdea1ceb9f480d6116b3d12855554b382d33692/transactions
and it downloads all of them in the CSV file. But older transactions are missing (from both pagination and CSV file).
Then I checked the code and found that the exportTransactions( ) method invoked by the "Export CSV" button click ultimately calls transactionDataset.getTopTransactionsLive() method only providing the member id parameter (any other parameter set as undefined).
You can find it in the file:
<EMAIL_ADDRESS>line number 197 and 200
Now, I can't find the documentation or source code for this method: getTopTransactionsLive()
All I found is this:
https://github.com/search?q=repo%3Asoonaverse%2Fapp getTopTransactionsLive&type=code
Is there a chance that the method mentioned is not returning all the data from the build5 API?

@adamunchained I checked and found the member profile does support pagination, eg. in my case there are 4 pages with transactions records: https://soonaverse.com/member/0x4bdea1ceb9f480d6116b3d12855554b382d33692/transactions and it downloads all of them in the CSV file. But older transactions are missing (from both pagination and CSV file).
Then I checked the code and found that the exportTransactions( ) method invoked by the "Export CSV" button click ultimately calls transactionDataset.getTopTransactionsLive() method only providing the member id parameter (any other parameter set as undefined).
You can find it in the file<EMAIL_ADDRESS>line number 197 and 200
Now, I can't find the documentation or source code for this method: getTopTransactionsLive() All I found is this: https://github.com/search?q=repo%3Asoonaverse%2Fapp getTopTransactionsLive&type=code
Is there a chance that the method mentioned is not returning all the data from the build5 API?

I’m sorry maybe I should have provided clearer explanation.
What you see is client pagination. UI framework paginates over an array it gets. This is a legacy issue where initially when it was implemented it was just getting “all transactions” from server. This is super inefficient and can create security issues especially for users with lot of transactions as they would be able to overload our API’s.
With B5 API’s we have set a limit that max result per any query is 100 records. Industry standard really. If there is more, clients need to paginate on the server side.
Soonaverse App needs to implement server paginations to fix this.


gym is building the archive/ipa using a different app_identifier

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I read the Contribution Guidelines
[x] I read docs.fastlane.tools
[x] I searched for existing GitHub issues

Issue Description
Hi, I've replaced the console output with dev-identifier, dev-provision and dev-app-id so you can search and check if the output is as expected.
I've been struggling to get the gym method to build the binary using a different app_identifier specified in the Appfile for "beta" lane.
All the output seems to be correct but the generated archive/ipa file is using production app_identifier instead of the beta app_identifier.
Btw, I've read in different topic which mentioned the Appfile app_identifier is only intended to be used with deliver method but not doesn't seems to be explicitly mentioned in the docs and from what I've seen from the console output, it seems to work fine with gym method too, maybe someone can help clarify this behavior or this was a bug?
Complete output when running fastlane, including the stack trace and command used

You can use: --capture_output as the last commandline argument to get that collected for you

fastlane beta
[15:03:30]: -------------------------------------------------
[15:03:30]: --- Step: Verifying required fastlane version ---
[15:03:30]: -------------------------------------------------
[15:03:30]: Your fastlane version 2.61.0 matches the minimum requirement of 2.61.0  ✅
[15:03:30]: ------------------------------
[15:03:30]: --- Step: default_platform ---
[15:03:30]: ------------------------------
[15:03:30]: Driving the lane 'ios beta' 🚀
[15:03:30]: ------------------------------------
[15:03:30]: --- Step: increment_build_number ---
[15:03:30]: ------------------------------------
Current version of project <redacted> is:
    217

/Users/romy/Documents/projects/<redacted>-client-ios
[15:03:32]: $ cd /Users/romy/Documents/projects/<redacted>-client-ios && agvtool next-version -all && cd -
[15:03:33]: ▸ Setting version of project <redacted> to:
[15:03:33]: ▸ 218.
[15:03:33]: ▸ Also setting CFBundleVersion key (assuming it exists)
[15:03:33]: ▸ Updating CFBundleVersion in Info.plist(s)...
[15:03:33]: ▸ Updated CFBundleVersion in "<redacted>.xcodeproj/../<redacted>/Info.plist" to 218
[15:03:33]: ▸ Updated CFBundleVersion in "<redacted>.xcodeproj/../<redacted>Tests/Info.plist" to 218
[15:03:33]: ▸ /Users/romy/Documents/projects/<redacted>-client-ios
[15:03:34]: ------------------------------------
[15:03:34]: --- Step: Switch to ios itc lane ---
[15:03:34]: ------------------------------------
[15:03:34]: Cruising over to lane 'ios itc' 🚖
[15:03:34]: ------------------
[15:03:34]: --- Step: sigh ---
[15:03:34]: ------------------

+-------------------------------------+-----------------------+
|                   Summary for sigh 2.61.0                   |
+-------------------------------------+-----------------------+
| skip_install                        | true                  |
| development                         | false                 |
| adhoc                               | false                 |
| force                               | false                 |
| app_identifier                      | *dev-identifier*   |
| username                            | <redacted> |
| team_id                             |<redacted>            |
| ignore_profiles_with_different_name | false                 |
| skip_fetch_profiles                 | false                 |
| skip_certificate_verification       | false                 |
| platform                            | ios                   |
+-------------------------------------+-----------------------+

[15:03:34]: Starting login with user '<redacted>'
[15:03:38]: Successfully logged in
[15:03:38]: Fetching profiles...
[15:03:40]: Verifying certificates...
[15:03:41]: Found 1 matching profile(s)
[15:03:41]: Downloading provisioning profile...
[15:03:44]: Successfully downloaded provisioning profile...
/Users/romy/Documents/projects/<redacted>-client-ios/*dev-provision*
[15:03:44]: Setting Provisioning Profile type to 'app-store'
[15:03:44]: --------------------------------------
[15:03:44]: --- Step: Switch to ios build lane ---
[15:03:44]: --------------------------------------
[15:03:44]: Cruising over to lane 'ios build' 🚖
[15:03:44]: -----------------
[15:03:44]: --- Step: gym ---
[15:03:44]: -----------------
[15:03:44]: Successfully loaded '/Users/romy/Documents/projects/<redacted>-client-ios/fastlane/Gymfile' 📄

+--------------------+----------------------+
| Detected Values from './fastlane/Gymfile' |
+--------------------+----------------------+
| scheme             | <redacted>             |
| include_bitcode    | true                 |
| workspace          | <redacted>.xcworkspace |
| output_directory   | ../                  |
| output_name        | <redacted>             |
| xcargs             | ARCHIVE=YES          |
+--------------------+----------------------+

[15:03:44]: Successfully loaded '/Users/romy/Documents/projects/<redacted>-client-ios/fastlane/Gymfile' 📄
[15:03:44]: No values defined in './fastlane/Gymfile'
[15:03:44]: $ xcodebuild -list -workspace <redacted>.xcworkspace
[15:03:47]: $ xcodebuild -showBuildSettings -workspace <redacted>.xcworkspace -scheme <redacted>
[15:03:53]: Detected provisioning profile mapping: {:"*dev-identifier*"=>"*dev-provision*"}

+--------------------------------------+--------------------------------------+
|                           Summary for gym 2.61.0                            |
+--------------------------------------+--------------------------------------+
| export_method                        | app-store                            |
| export_options.provisioningProfiles  | *dev-identifier* AppStore         |
| .*dev-identifier*                 |                                      |
| scheme                               | <redacted>                             |
| include_bitcode                      | true                                 |
| workspace                            | <redacted>.xcworkspace                 |
| output_directory                     | ../                                  |
| output_name                          | <redacted>                             |
| xcargs                               | ARCHIVE=YES                          |
| destination                          | generic/platform=iOS                 |
| build_path                           | /Users/romy/Library/Developer/Xcode  |
|                                      | /Archives/2017-10-17                 |
| clean                                | false                                |
| silent                               | false                                |
| skip_package_ipa                     | false                                |
| buildlog_path                        | ~/Library/Logs/gym                   |
| xcode_path                           | /Applications/Xcode.app              |
+--------------------------------------+--------------------------------------+

[15:03:53]: $ set -o pipefail && xcodebuild -workspace <redacted>.xcworkspace -scheme <redacted> -destination 'generic/platform=iOS' -archivePath /Users/romy/Library/Developer/Xcode/Archives/2017-10-17/<redacted>\ 2017-10-17\ 15.03.53.xcarchive ARCHIVE=YES archive | tee /Users/romy/Library/Logs/gym/<redacted>-<redacted>.log | xcpretty
[15:11:43]: Generated plist file with the following values:
[15:11:43]: ▸ -----------------------------------------
[15:11:43]: ▸ {
[15:11:43]: ▸   "provisioningProfiles": {
[15:11:43]: ▸     "*dev-identifierI*": "*dev-provisioning*"
[15:11:43]: ▸   },
[15:11:43]: ▸   "method": "app-store",
[15:11:43]: ▸   "uploadBitcode": true
[15:11:43]: ▸ }
[15:11:43]: ▸ -----------------------------------------

[15:12:31]: Successfully exported and compressed dSYM file
[15:12:31]: Successfully exported and signed the ipa file:
[15:12:31]: /Users/romy/Documents/projects/<redacted>.ipa
[15:12:31]: Cruising back to lane 'ios itc' 🚘
[15:12:31]: -------------------
[15:12:31]: --- Step: pilot ---
[15:12:31]: -------------------
[15:12:31]: Login to iTunes Connect (<redacted>)
[15:12:36]: Login successful
[15:12:37]: Ready to upload new build to TestFlight (App: *dev-app-id*)...
[15:12:37]: Going to upload updated app to iTunes Connect
[15:12:37]: This might take a few minutes. Please don't interrupt the script.
[15:13:21]: [Transporter Error Output]: description length:9022646
[15:14:05]: [Transporter Error Output]: ERROR ITMS-90055: "This bundle is invalid. The bundle identifier cannot be changed from the current value, '*dev-identifier*'. If you want to change your bundle identifier, you will need to create a new application in iTunes Connect."
[15:14:05]: [Transporter Error Output]: ERROR ITMS-90053: "This bundle is invalid. The bundle identifier is already in use by a different software package."
[15:14:05]: Transporter transfer failed.
[15:14:05]:
[15:14:05]: description length:9022646
ERROR ITMS-90055: "This bundle is invalid. The bundle identifier cannot be changed from the current value, '*dev-identifier*'. If you want to change your bundle identifier, you will need to create a new application in iTunes Connect."
ERROR ITMS-90053: "This bundle is invalid. The bundle identifier is already in use by a different software package."
[15:14:05]: [iTMSTransporter] [2017-10-17 15:14:05 MYT] <main> ERROR: ERROR ITMS-90055: "This bundle is invalid. The bundle identifier cannot be changed from the current value, '*dev-identifier*'. If you want to change your bundle identifier, you will need to create a new application in iTunes Connect."

[15:14:05]: [iTMSTransporter] [2017-10-17 15:14:05 MYT] <main> ERROR: ERROR ITMS-90053: "This bundle is invalid. The bundle identifier is already in use by a different software package."

[15:14:05]: [iTMSTransporter] [2017-10-17 15:14:05 MYT] <main> DBG-X: The error code is: 1102

[15:14:05]: [iTMSTransporter] [2017-10-17 15:14:05 MYT] <main>  INFO: Done performing authentication.

[15:14:05]: [iTMSTransporter]

[15:14:05]: [iTMSTransporter]

[15:14:05]: [iTMSTransporter]

[15:14:05]: [iTMSTransporter] Package Summary:

[15:14:05]: [iTMSTransporter]

[15:14:05]: [iTMSTransporter] 1 package(s) were not uploaded because they had problems:

[15:14:05]: [iTMSTransporter] 	/var/folders/wb/lrqvdg7s5m9d0xmfv6dd0f8h0000gn/T/d20171017-41861-46c09b/1296696953.itmsp - Error Messages:

[15:14:05]: [iTMSTransporter] 		description length:9022646

[15:14:05]: [iTMSTransporter] 		ERROR ITMS-90055: "This bundle is invalid. The bundle identifier cannot be changed from the current value, '*dev-identifier*'. If you want to change your bundle identifier, you will need to create a new application in iTunes Connect."

[15:14:05]: [iTMSTransporter] 		ERROR ITMS-90053: "This bundle is invalid. The bundle identifier is already in use by a different software package."

[15:14:05]: [iTMSTransporter] [2017-10-17 15:14:05 MYT] <main> DBG-X: Returning 1

[15:14:05]: iTunes Transporter output above ^
[15:14:05]: description length:9022646
ERROR ITMS-90055: "This bundle is invalid. The bundle identifier cannot be changed from the current value, '*dev-identifier*'. If you want to change your bundle identifier, you will need to create a new application in iTunes Connect."
ERROR ITMS-90053: "This bundle is invalid. The bundle identifier is already in use by a different software package."
\nERROR ITMS-90055: "This bundle is invalid. The bundle identifier cannot be changed from the current value, '*dev-identifier*'. If you wan\nERROR ITMS-90053: "This bundle is invalid. The bundle identifier is already in use by a different software package."
The call to the iTMSTransporter completed with a non-zero exit status: 1. This indicates a failure.
[15:14:06]: --------------------------------------
[15:14:06]: --- Step: Switch to ios clean lane ---
[15:14:06]: --------------------------------------
[15:14:06]: Cruising over to lane 'ios clean' 🚖
[15:14:06]: ----------------------------
[15:14:06]: --- Step: reset_git_repo ---
[15:14:06]: ----------------------------
[15:14:06]: $ git reset --hard HEAD
[15:14:06]: ▸ HEAD is now at 1107ab4 Updated:
[15:14:06]: Git repo was reset and cleaned back to a pristine state.
[15:14:06]: Cruising back to lane 'ios itc' 🚘
[15:14:06]: --------------------------
[15:14:06]: --- Step: notification ---
[15:14:06]: --------------------------
+--------------------+--------------------------------------+
|                       Lane Context                        |
+--------------------+--------------------------------------+
| DEFAULT_PLATFORM   | ios                                  |
| PLATFORM_NAME      | ios                                  |
| LANE_NAME          | ios beta                             |
| BUILD_NUMBER       | 218                                  |
| SIGH_PROFILE_PATH  | /Users/romy/Documents/projects/*dev-provision*  |
|                    | t.test.mobileprovision               |
| SIGH_PROFILE_PATHS | ["/Users/romy/Documents/projects/bo  |
|                    | ost-client-ios/AppStore_my.com.mybo  |
|                    | ost.test.mobileprovision"]           |
| SIGH_PROFILE_TYPE  | app-store                            |
| IPA_OUTPUT_PATH    | /Users/romy/Documents/projects/<redacted>.ipa                             |
| DSYM_OUTPUT_PATH   | /Users/romy/Documents/projects/<redacted>.app.dSYM.zip                    |
| XCODEBUILD_ARCHIVE | /Users/romy/Library/Developer/Xcode  |
|                    | /Archives/2017-10-17/<redacted>        |
|                    | 2017-10-17 15.03.53.xcarchive        |
+--------------------+--------------------------------------+
[15:14:06]: Error uploading ipa file, for more information see above

+------+------------------------+-------------+
|              fastlane summary               |
+------+------------------------+-------------+
| Step | Action                 | Time (in s) |
+------+------------------------+-------------+
| 1    | Verifying required     | 0           |
|      | fastlane version       |             |
| 2    | default_platform       | 0           |
| 3    | increment_build_numbe  | 4           |
|      | r                      |             |
| 4    | Switch to ios itc      | 0           |
|      | lane                   |             |
| 5    | sigh                   | 9           |
| 6    | Switch to ios build    | 0           |
|      | lane                   |             |
| 7    | gym                    | 527         |
| 💥   | pilot                  | 93          |
| 9    | Switch to ios clean    | 0           |
|      | lane                   |             |
| 10   | reset_git_repo         | 0           |
| 11   | notification           | 0           |
+------+------------------------+-------------+

[15:14:06]: fastlane finished with errors

[!] Error uploading ipa file, for more information see above

Environment
✅ fastlane environment ✅
Stack

Key
Value

OS
10.12.6

Ruby
2.2.4

Bundler?
false

Git
git version 2.13.5 (Apple Git-94)

Installation Source
~/.fastlane/bin/bundle/bin/fastlane

Host
Mac OS X 10.12.6 (16G29)

Ruby Lib Dir
~/.fastlane/bin/bundle/lib

OpenSSL Version
OpenSSL 1.0.2g  1 Mar 2016

Is contained
true

Is homebrew
false

Is installed via Fabric.app
false

Xcode Path
/Applications/Xcode.app/Contents/Developer/

Xcode Version
9.0

System Locale

Variable
Value

LANG
en_US.UTF-8
✅

LC_ALL
en_US.UTF-8
✅

LANGUAGE
en_US.UTF-8
✅

fastlane files:
`./Fastfile`
fastlane_version "2.61.0"

default_platform :ios

platform :ios do
  ############################## PRE ##############################

  before_all do
    ensure_git_status_clean

    # Increase build number by 1
    increment_build_number()
  end

  ######################### PUBLIC LANES ##########################

  lane :beta do
    itc(scheme: "Beta")
  end

  lane :release do
    itc(scheme: "Release")
  end

  #--------------------------- App Store -------------------------#

  private_lane :itc do |options|
    scheme = options[:scheme]

    sigh(
      skip_install: true,
      development: false,
    )

    build(
      scheme: scheme,
    )

    pilot(
      skip_submission: true,
    )

    post_to_slack(scheme: scheme, destination: "TestFlight")

  end

  ############################# UTIL ##############################

  private_lane :build do |options|
    gym()
  end

  private_lane :post_to_slack do |options|
    scheme      = options[:scheme]
    version     = get_version_number(xcodeproj: "<redacted>.xcodeproj")
    build       = get_build_number(xcodeproj: "<redacted>.xcodeproj")
    environment = scheme.upcase
    destination = options[:destination]

    slack(
      message: "New :ios: *#{version}* (#{build}) running `#{environment}` has been submitted to *#{destination}* :rocket:",
      channel: "<redacted>"
    )

  end

  private_lane :clean do |options|
    # Reset the changes created by fastlane
    reset_git_repo(
      skip_clean: true,
      force: true
    )
  end

  ############################# POST ##############################

  # This lane is called, only if the executed lane was successful
  after_all do |lane|

    File.delete("../../<redacted>.ipa")
    File.delete("../../<redacted>.app.dSYM.zip")

    build = Actions.lane_context[Actions::SharedValues::BUILD_NUMBER]

    commit_version_bump(
      message: "Updated: Build number to #{build}"
    )

    # Mac OS X Notification
    notification(
      message: "Fastlane finished '#{lane}' successfully"
    )
  end

  error do |lane, exception|
    build = Actions.lane_context[Actions::SharedValues::BUILD_NUMBER]

    clean()

    # Mac OS X Notification
    notification(
      message: "Fastlane '#{lane}' errored"
    )
  end
end

`./Appfile`
apple_id "<redacted>"
team_id "<redacted>"

# Use different bundle identifiers for each lane

for_platform :ios do
  	for_lane :beta do
    	       app_identifier "*dev-identifier*"
  	end

  	for_lane :release do
  		app_identifier "*release-identifier*"
  	end
end

fastlane gems

Gem
Version
Update-Status

fastlane
2.61.0
✅ Up-To-Date

Loaded fastlane plugins:
No plugins Loaded
Loaded gems

Gem
Version

CFPropertyList
2.3.5

addressable
2.5.1

babosa
1.0.2

bigdecimal
1.2.6

bundler
1.14.6

claide
1.0.2

colored
1.2

colored2
3.1.2

commander-fastlane
4.4.5

declarative
0.0.10

declarative-option
0.1.0

domain_name
0.5.20170404

dotenv
2.2.0

excon
0.55.0

faraday
0.12.1

faraday-cookie_jar
0.0.6

faraday_middleware
<IP_ADDRESS>

fastimage
2.1.0

gh_inspector
1.0.3

google-api-client
0.13.6

googleauth
0.5.1

highline
1.7.8

http-cookie
1.0.3

httpclient
2.8.3

hurley
0.2

io-console
0.4.3

json
1.8.1

jwt
1.5.6

libxml-ruby
3.0.0

little-plugger
1.1.4

logging
2.2.2

memoist
0.15.0

mime-types
3.1

mime-types-data
3.2016.0521

mini_magick
4.5.1

minitest
5.4.3

multi_json
1.12.1

multi_xml
0.6.0

multipart-post
2.0.0

nanaimo
0.2.3

nokogiri
1.5.6

os
0.9.6

plist
3.2.0

power_assert
0.2.2

psych
2.0.8

public_suffix
2.0.5

rake
10.4.2

rdoc
4.2.0

representable
3.0.4

retriable
2.1.0

rouge
1.11.1

rubygems-update
2.5.2

rubyzip
1.2.1

security
0.1.3

signet
0.7.3

slack-notifier
1.5.1

sqlite3
1.3.13

terminal-notifier
1.7.1

terminal-table
1.7.3

test-unit
3.0.8

tty-screen
0.5.0

uber
0.0.15

unf
0.1.4

unf_ext
<IP_ADDRESS>

unicode-display_width
1.1.3

word_wrap
1.0.0

xcodeproj
1.5.2

xcpretty
0.2.6

xcpretty-travis-formatter
0.0.4

generated on: 2017-10-17

Just an idea:

All the output seems to be correct but the generated archive/ipa file is using production app_identifier instead of the beta app_identifier.

If you open you Xcode project and change the identifier to something totally else, does it by chance then generate a binary for that identifier?

Closing this since no response lately 😊


Add an option to add regex to ignore locations.

It would be really great to have regex filters similar to Hide specific referrers for URL / location, as there are websites where tokens are appended onto the end, and it makes the list of locations insanely long.

Yes, this could definitely be helpful. Adding it to the roadmap.
Could also be helpful to add an option to ignore query parameters.


Add timestamp support to forever log

With forever set timestamp true the log will contain timestamps,
fixes #309 and #314

I know this is old but what ever happened to adding support for timestamps in forever logs?


Patch for http to https proxy

Set agent for proxy to address connection refused for proxying request from http to https.
See: https://github.com/nodejitsu/node-http-proxy/blob/caronte/examples/http/proxy-http-to-https.js
It also requires setting of host headers but that can be passed using proxy config.

Isn't this covered by PR #101 ? (which also as improved default port handling and fixed usage of the proxy api)

I am not really sure the title for this PR is correct.
@sukrit007 What is the goal of that agent property?

@ruiaraujo  Looks like there are some conflicts now.  I will rebase my changes and squash commits.
Purpose of the agent property and PR:
Basically I am running into issue where in if I have http frontend with https proxy backend,  I get "Connection Refused".   FOr reference here is the issue :
https://github.com/nodejitsu/node-http-proxy/issues/304
To address this issue, we need to do 2 things:

Pass the host header
Pass the agent property

I could do first one by passing explicit headers, but could not set the agent property.

@io41  I looked at the PR but did not see agent property. I will rebase my changes and pass the agent property. I need agent property to address http to https proxy (See explanation above)

@ruiaraujo : Ready for review
Changes:

re-based my changes. ( also squashed commits)
resolved merge conflicts
Added ability to override host header

Just wanted to followup on this PR. Do you need anything else wrt same ?

@ruiaraujo Hi, can you please merge this? I've ran into this issue with my setup as well and this pull request fixed it.

@cosmin-dumitrache   working fine on Chrome/Safari. Can you provide exact steps.
Also I will rebase the changes  to resolve conflicts.  @ruiaraujo:  Would you need me to address anything else in this PR ?


clientv3/concurrency: STM

Repeatable read and serialized read STM implementations.

This implementation is good enough for the proxy I've been writing. /cc @xiang90 @barakmich

all updated /cc @xiang90

LGTM.


rustup reports unknown version

based on call for testing
$ git clone https://github.com/rust-lang/rustup.rs --depth=1
Cloning into 'rustup.rs'...
remote: Enumerating objects: 163, done.
remote: Counting objects: 100% (163/163), done.
remote: Compressing objects: 100% (138/138), done.
remote: Total 163 (delta 6), reused 49 (delta 2), pack-reused 0
Receiving objects: 100% (163/163), 608.54 KiB | 1.89 MiB/s, done.
Resolving deltas: 100% (6/6), done.

$ cd rustup.rs

$ cargo +stable run --features vendored-openssl -- --no-modify-path -y
  Downloaded env_proxy v0.3.1
  Downloaded hyper v0.12.33
...snip
    Finished dev [unoptimized + debuginfo] target(s) in 1m 17s
     Running `target/debug/rustup-init --no-modify-path -y`
info: profile set to 'default'
info: updating existing rustup installation

Rust is installed now. Great!

To get started you need Cargo's bin directory
(/home/max/.local/share/cargo/bin) in your PATH environment variable.

$ rustup --version
rustup unknown (279e802a0 2019-09-17)

$ rustup show
Default host: x86_64-unknown-linux-gnu
rustup home:  /home/max/.local/share/rustup

installed toolchains
--------------------

stable-x86_64-unknown-linux-gnu
nightly-2019-06-20-x86_64-unknown-linux-gnu
nightly-2019-09-13-x86_64-unknown-linux-gnu (default)
nightly-x86_64-unknown-linux-gnu

active toolchain
----------------

nightly-2019-09-13-x86_64-unknown-linux-gnu (default)
rustc 1.39.0-nightly (eb48d6bde 2019-09-12)

Sorry, my fault, this was caused by --depth=1 during git clone.
Feel free to close.

Correct, rustup consumes the git history during build in order to report version information.  Shallow clones of this little context will not work to report a useful version number, sorry.


Added Chrome and ChromeDriver installation. Updated Java installation.

Added Chrome and ChromeDriver installation. Updated Java installation. Added gitignore file.
I have tested the installations on a Linux machine. And on a few windows versions. Might be worth testing n your own setup.

Hi, thanks for the PR. Before I merge, is there any reason why you have chosen Java7 instead of Java8?

@gpkvt It was the JDK version I was originally able to download via cURL, install and see working properly.
It could be possible to replace for:
curl -j -o Tools/jre-windows-i586.exe -L -O -H "Cookie: oraclelicense=accept-securebackup-cookie" http://download.oracle.com/otn-pub/java/jdk/8u45-b15/jre-8u45-windows-i586.exe
However, so far I have not tested beyond seeing that it downloads a file roughly 35MB in size. I would need to either produce a subsequent pull request or withdraw the current one and reopen once I have had time to "test" it.

Java7 works for me. I was just being curious if there were any problems with Java8.


Adopt the new ClientBuilder::session_paths method.

Corresponding PR for the change at https://github.com/matrix-org/matrix-rust-sdk/pull/3887

I'm going to yolo this without a review as CI is happy and without it SDK PRs are going to fail.


Add OpenGL renderer (squashed)

Squashed version of https://github.com/godotengine/godot/pull/53150. The original PR is left untouched for future reference.

I pushed the rename from OpenGL to GLES3. Let me know if it's OK, then I can squash it on top of the most recent commit.

@Calinou This looks perfect to me, feel free to squash, very eager to merge it!

Thanks to all involved!

This is amazing! Tomorrow will work a bit on the new shader compiler and canvas shader. Will try to port the base RenderingDevice code and get it to work, so @Calinou and others can implement the rest of the features.


Icons won't show when selecing items

shows the one I had selected previously
and shows nothing when nothing was selected previously

texture loading has been patched in, now works.


Reorganised behaviour docs to match other IS's

Created a new "4.0 Behaviour.md" which links to the "4.x Behaviour - xxx.md" docs, which all have their numbers increased by 0.1.  This then matches what we have done elsewhere, and what make-indexes.sh in nmos-doc-build-scripts expects.
I've checked locally that this renders as follows:

Behaviour

Authorization Servers
Clients
Token Requests
Access Tokens
Resource Servers

Also, it's now "4.1. Behaviour - Authorization Servers.md" (plural) and some text updated, for consistency.

CI still failing because of #14. Maybe someone could merge that first?

i've cherry picked the long-line fix from #14, now passing


Text change on QR screen.

Recovery request. Not recover request

Verified this issue on dev app v1.9.5(334)


allow subcommands to relax on missing required arguments

Often all subcommands require some arguments except one of two subcommands that don't require them. Instead of having to define the arguments on every subcommand, we want to define them on the top level but tell the subcommands that don't require them to relax if they are not present.

it would be good to have also a more general option to skip certain options totally and that would affect the help message of a subcommand: It would merge all but the skipped general options in.


Remove duplicate codeFlavor documentation

One of the 2 identical codeFlavor configuration parameters in the maven plugin docs was removed.

Merged into master with 3f8b30ac9b47425d1a6e75183e4d5d0fe81a2c23


Added minItemLength prop and behaviour

The minItemLength determines how many items must remain before the suggestion window is hidden. The existing code only hides the suggestion list once no items match, but I would like the option to hide the list when only one item matches. This prop enables this, but doesn't change the existing default behaviour.

I like it! It's merged already, I'll make a release with this prop right away.
Thanks a lot, really appreciated!

Thanks! I appreciate it!


aliyun oss mode RamRoleArn ignores proxy-host setting

- Command Format:
aliyun oss ls --mode RamRoleArn --proxy-host http://anyhost:8000
- Execution Command:
it does not show anything
- Output:
it keeps running without end
I am running aliyun command in a corporate network with proxy servers. I use
aliyun oss ls --mode RamRoleArn --proxy-host http://anyhost:8000
Version: 3.0.144, 3.0.132 both Windows and Linux versions
Environment variables set: http_proxy, https_proxy, HTTP_PROXY, HTTPS_PROXY
Finally if I wait long enough I get this error:
ERROR: can't get credential refresh RoleArn sts token err: Get https://sts.aliyuncs.com/*AccessKeyId=***&Action=AssumeRole&DurationSeconds=3600&Format=JSON&RoleArn=ROLE&RoleSessionName=SESSION_NAME&Signature=**&SignatureMethod=HMAC-SHA1&SignatureNonce=**&SignatureVersion=1.0&Timestamp=**&Version=**" dial tcp <IP_ADDRESS>:443: connect: connection timed out.
I captured the traffic via Wireshark and figured out that another modes like AK, StsToken do not ignore --proxy-host setting and work fine.

Please use the latest version, this is fixed.


Fix kf_is_ready_test

istio_egressgateway is no longer deployed so need to remove it from
list of deployments we check for; it doesn't seem to be required
to enable outbound internet access.

Split up the kf_is_ready_test into more focused tests

Related to kubeflow/gcp-blueprints#73

/assign @vpavlin
/assign @Bobgy

Looks like unittests failed because we are out of disk space on our NFS mount.

/lgtm

/test all

No specific error; looks like a timeout downloading go modules
/test all

/approve

/lgtm


VOD Episode issue

Seem that VOD Episodes missing place to input or select parent VOD.
Additional, why you don't create a new table in database to store VOD Episode data, because vod title, description, IMDB, and other information belong to VOD. So that no need to input that information again in VOD Episodes.

Hello!
We are working on that and will be ready on the next update of the management system

Hello!
We are working on that and will be ready on the next update of the management system

Great news @irisstaro !