test(osm-bootstrap): add unit tests for mesh config

adds unit tests for mesh config logic

Signed-off-by: Michelle Noorali<EMAIL_ADDRESS>
Description:

Testing done:

Affected area:

Functional Area

New Functionality
[ ]

CI System
[ ]

CLI Tool
[ ]

Certificate Management
[ ]

Control Plane
[ ]

Demo
[ ]

Documentation
[ ]

Egress
[ ]

Ingress
[ ]

Install
[ ]

Networking
[ ]

Observability
[ ]

Performance
[ ]

SMI Policy
[ ]

Security
[ ]

Sidecar Injection
[ ]

Tests
[ ]

Upgrade
[ ]

Other
[ ]

Please answer the following questions with yes/no.

Does this change contain code from or inspired by another project?

Did you notify the maintainers and provide attribution?

Is this a breaking change?

Codecov Report

Merging #4181 (769200c) into main (f262ef5) will increase coverage by 0.07%.
The diff coverage is 65.51%.

:exclamation: Current head 769200c differs from pull request most recent head db7181d. Consider uploading reports for the commit db7181d to get more accurate results

@@            Coverage Diff             @@
##             main    #4181      +/-   ##
==========================================
+ Coverage   69.91%   69.99%   +0.07%
==========================================
  Files         212      212
  Lines       11615    11630      +15
==========================================
+ Hits         8121     8140      +19
+ Misses       3441     3437       -4
  Partials       53       53

Flag
Coverage Δ

unittests
69.99% <65.51%> (+0.07%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

cmd/osm-bootstrap/osm-bootstrap.go
42.10% <65.51%> (+9.90%)
:arrow_up:

pkg/certificate/rotor/rotor.go
87.50% <0.00%> (+3.12%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f262ef5...db7181d. Read the comment docs.


Run tests with only the couch_db_plugin_test couch_epi plugin

Save current couch_epi application environment plugins in context during test setup, and restore during teardown.
COUCHDB-2868

@iilyak, does this look reasonable to you?

Maybe we should stop and unload couch_epi in teardown instead. Since we load and start it in setup. In this case there will be no need to remember current list of configured plugins.

I think it worth to add some test that cause failure for that case before fix it. Because, we didn't have such problem now and we eventually may break this again without any notice.

@iilyak, I agree with your last comment, as it seems a bit strange to save the plugin state while tests are running.
@kxepal, the reason check_is_admin_no_match was failing downstream was because -- in addition to loading the couch_db_pluging_tests plugin that was meant to handle that case -- all the couch_epi plugins specified in Cloudant's couch_epi.config were being loaded, and one of them was inadvertently handling (and breaking) the test case. I think any time a unit test pulls in configuration data that it doesn't completely specify, we run the risk of it breaking something downstream. I could certainly create another plugin that simulates what was happening, but I don't think it will really help prevent this sort of thing in the future. By loading only the plugins we want to test, we force test behavior downstream to be the same. Does that make sense?

The latest changes clean the setup/teardown code considerably, in addition to speeding up the test suite.
@kxepal, may I suggest that if we want an example test showing epi plugin collisions/interference, that we create a separate issue for that? I'm happy to tackle that if we can get this resolved...

+1

@jaydoane ok with separate issue. +1


"Ran out of routes to try after XX attempts"

Hey,
I open this request to track the error we have in our app since the recent events. I heard from Breez that most of the issues are behind us and that it should work again but we still have issues.
The error we get for each payment:
Payment timeout: status: Unknown, message: "Error calling method Pay:
RcError { code: Some(210), message:
"Ran out of routes to try after XX attempts: see 'paystatus'", data:
None }", details: [], metadata:
MetadataMap { headers: {"content-type": "application/grpc", "date":
"Wed, 24 Apr 2024 19:41:46 GMT",
"content-length": "0"} }

Sender's node id:
03811368ccafc98c085998a5113ad669f22cbbabc88e5a00ea52aff5ae8c824abb

Receiver's invoice
lnbc150n1pnz5juudqqpp5ru55jnh7uj2d7a6mt5mmy5uqn4v4ant39d8w776esfqt320e9upsxqrrsssp5cjhadgzczq4spyh9jn0eu547mm3pt9depqswhft0fvc4xd0mhhqq9qrsgqcqzysrzjqtypret4hcklglvtfrdt85l3exc0dctdp4qttmtcy5es3lpt6uts6jrcryfj7cp3lgqqqqlgqqqqqzsqjqva9n0jrq9regtp3xg28kyr46srqzthyxsa24d847rr2uedjr7hxhcy2vjkpv895m4hrql85l0yajsmfgl2k4du2ulxqpyklfygrn89sqnrzuv3

Our LSP is LQWD:
03232432128398d8cb31e67921ffd4d4cfb10b42dc72529a45dba6f105adfb83d4

Let me know if you need more data or informations.
Best,
Simon.

@simongltr can you please try again and report if the issue is still happening?

@simongltr can you please try again and report if the issue is still happening?

We tried again, it fails but with a different error message
Payment timeout: status: Unknown, message: "Error calling method Pay:
RpcError { code: Some(210), message:
\"Destination 032f6993f42C8a01405e33bba6080237c07a7e67f62f1d7da407ef7e390cafc606 is not
reachable directly and all routehints
were unusable.\", data: None }", details:
Il, metadata: MetadataMap { headers: {"content-type": "application/grpc",
"date": "Fri, 26 Apr 2024 11:46:23
GMT", "content-length": "0"} }

@simongltr there was another fix deployed (more on Monday), could you please try again? Try to make a few payments if possible.

@simongltr there was another fix deployed (more on Monday), could you please try again? Try to make a few payments if possible.

My node ID is 032f6993f42c8a01405e33bba6080237c07a7e67f62f1d7da407ef7e390cafc606
I just tried paying<EMAIL_ADDRESS><EMAIL_ADDRESS>I got respectively:
"Ran out of routes to try after 2 attempts" and "Ran out of routes to try after 1 attempts"
A few payments worked but it was to pay myself.
One of the payments to WalletOfSatoshi gave me no error but after 3 minutes of waiting time I stopped it. This one was appended to my transaction history, but not on WalletOfSatoshi's side. It's just a display bug our our side because we don't have a filter to eliminate unsuccessful payments. No preimage so no payment ...

@simongltr thank you 🙏 can you please try a new node as well?

I created a fresh node 02bf04e333701fa02859af1eeccecc3052a9a51b55821c5487560b30467ca59336 but I got this error during the sync:
Generic: Generic: Generic: status: Unknown, message: "transport error", details: [1, metadata: MetadataMap { headers: t}

After restarting the app the node synced successfully but I can't generate any invoice or do any action. It seems like important setup steps were skipped because of the error. For instance I have no LSP attributed to this node.
On monday I will try again with the SDK but on desktop in CLI mode, at least to try on a different environment and try to collect better data. Thank you for helping us !

Tried again with another fresh node: 023b9a720f6d21c97416586f428d5b360e895350ecb5df7980ac799aa577c85eb1
-> Synced with no error, tried to generate the first invoice of 10,000 but no response, and now the node is not syncing anymore. When I restart the app it syncs, I try again the generate the invoice and no response, can't sync, ... I see no LSP attributed to me
Tried again with a fresh node after reinstalling the app: 03ab83d878e884c7533e359dd1754ffea42fe8ceb0b99baeeef7855ed61d284a31
-> same, it syncs, no LSP, can't generate an invoice

@simongltr any log files from the Breez SDK would also be very helpful. With the CLI there should be a log file created in the data directory, when using the SDK the method set_log_stream can be used to capture the SDK log stream.

@simongltr any log files from the Breez SDK would also be very helpful. With the CLI there should be a log file created in the data directory, when using the SDK the method set_log_stream can be used to capture the SDK log stream.

I tried with the CLI, I get the same error:
Error: Payment timeout: status: Unknown, message: "Error calling method Pay: RpcError { code: Some(210), message: \"Ran out of routes to try after 2 attempts: see `paystatus`\", data: None }", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Mon, 29 Apr 2024 14:13:17 GMT", "content-length": "0"} }

This time I can give you the logs:
sdk.log
Here is the history file:
#V2
help
sync
node_info
service_health_check
set_api_key
set_api_key <API_KEY>
service_health_check
node
node_info
connect
node_info
lsp_info
send_payment
sync
send_payment lnbc200n1pnzl2kypp5zzkh2vxss5h77qjm9sq2hsau40htv30nla3hfv3r20auuzdmja6sdqqcqzzsxqyz5vqsp5t6we92quxgq8m3z6vuwe2xmv52394fawe75n4n2cd6cwvmcrltfq9qyyssqx88uphmt06dshldftj7xggmjvuyduezkx4zycun3me9tsp5eu5s84ce3sxs4ppnshkh6kruyzzvvq3q6qsy4sfaq9vxszfcl2p6rnasplxn02u
``

@dangeross please check the logs and you can also work with Simon to use the same seed yourself. This seems like a gossip issue, so if you come tho same conclusion, let's involve the GL team ASAP.

Yeah I can give you my seed @dangeross, just give me a PGP key or keybase account I can encrypt to

Thanks @simongltr, I'll look through the logs and let you know if the seed would be helpful too

Just to mention it, it seems like when I was testing the CLI this morning a channel was closed

For node id 032f6993f42c8a01405e33bba6080237c07a7e67f62f1d7da407ef7e390cafc606
I think the reason is there are 2 pre-anchor channels, from what I can see it 2 were opened around Sept 2023 and 1 anchor channel Oct 2023. There are errors concerning the fee rate:
WARN lightning_signer::policy:78] policy failed: policy-commitment-fee-range validate_fee: feerate above maximum: 33803 > 25000
WARN lightning_signer::channel:1993] VALIDATION FAILED: Policy("validate_holder_commitment_tx: validate_commitment_tx: validate_fee: feerate above maximum: 33803 > 25000")

Channel 809595x2857x0 is pending close (pre-anchor), with 2 still open
The backup seems to be workings from this CLI, not seeing any failures
Do you have logs from your fresh nodes @simongltr ?

Do you have logs from your fresh nodes @simongltr ?

The commands I typed:
cargo run -- --data_dir /home/ubuntu/breez_data/E

sdk> connect -c /home/ubuntu/breez_data/client.crt -k /home/ubuntu/breez_data/client-key.pem
Node was connected successfully
sdk> sync
Sync finished successfully
sdk> set_api_key <KEY>
API key was set
sdk> lsp_info
Error: Generic: No LSP ID found
sdk> list_lsps
[]
sdk> receive_payment 10000000 debug
Error: Generic: No LSP ID found

The logs:
sdk.log
I tried multiple times and the issue was always a missing LDP IP

[UPDATE]
2 mobile devices with 2 fresh nodes:
1 node created using breez cli and imported into mobile app
1 node created directly in the mobile app
Both apps with funds ~5.000 sats
Test:
Pay 50 sats to an invoice of WoS
Result:
From the node with the seed created with breez cli and imported in mobile, the payment worked fine
From the node created in mobile fails with ran out of routes error
Attach logs from mobile app with the issue:
logs.txt

2 days ago @damiandizeo described (last message) a situation where a fresh node can be funded but can't pay because of a ran out of routeserror.
This node is now able to send payments, its node ID is 033070dc551a25d2bf6bf01cbf5f031cf2482c2a8c8d9be05ce5617ccc63e618ca.
This morning (around 2:44pm GMT) we successfully funded a new node with ID 028faee7d37af3aa91b74fee26507518e8293d4988a64cfd3ec8f1bae8790f8fbc by paying this invoice:
lnbc27500n1pnr8f57dqqpp52d49v0usjnaajgy7h9xv692s5l5pvjc0k3fqk53h0p6dw5y2wnjsxqrrsssp5uss29md0je8yp50ts5htm3k0n853gfty239fd37d7pqu457d3y8s9qrsgqcqzysrzjqv3jgvsjswvd3je3ueujrl756n8mzz6zm3e99xj9mwn0zpddlwpagqqqqyqqqqqqqqqqqqlgqqqqqqgqjqpze6a05fqy5ngw6nc9dalaxze6sh8ru9mzg4uum6zwdg9dn8dtrhjpp32l3jdnz663y5umedg03jsyusu0q7s9kdx4cfhq456xytuvspvx7hz5

Around 2:46pm GMT this node was not able to pay.
Around 5:22pm GMT we successfully sent a payment.

I tried fetching the logs, and all I could find was a successful payment today. This is most likely still an old report that predates the inclusion of ElementsProject/lightning#7190 :-)
If the problem does not persist, shall we close this?

Thank you for looking at our problem. I'm closing this issue as the situation has improved significantly compared to a few weeks ago. We are currently implementing new features in our app, so I will need to conduct thorough testing again in about a week to confirm that the issue has been resolved. If the problem persists, I will reopen the issue and provide as much data as possible.

The feerange issue is tracked here: https://github.com/Blockstream/greenlight/issues/538


Serializing with variant_to_binary is very slow

Find, why variant_to_binary works slow and fix it.

Currently create-genesis tool packs structs of system tables directly without using abi_serializer. If enable abi_serializer::variant_to_binary usage by commenting this line: https://github.com/GolosChain/cyberway/blob/41dc08ff4647030aabe572184bf48c77168c2a11/programs/create-genesis/serializer.hpp#L13
then processing slows down greatly. Serializing structs of contracts is very slow too
https://github.com/GolosChain/cyberway/blob/41dc08ff4647030aabe572184bf48c77168c2a11/programs/create-genesis/serializer.hpp#L152

looks like the issue is system-dependent: it requires ~3 minutes on server, but takes ~40 minutes on local macos machine.
Profiling showed the problem is in memory allocation: https://github.com/GolosChain/cyberway/blob/254cebcf99cdb3ba7c232b4ff16fdc364c946be0/libraries/chain/abi_serializer.cpp#L558


Adding this to the web middleware breaks other packages

Adding \ErlandMuchasaj\LaravelGzip\Middleware\GzipEncodeResponse::class to the 'web' middlwareGroup causes packages such a Spatie cookie consent and the laravel debug bar to not display anymore.

Adding \ErlandMuchasaj\LaravelGzip\Middleware\GzipEncodeResponse::class to the 'web' middlwareGroup causes packages such a Spatie cookie consent and the laravel debug bar to not display anymore.

Thanks for the info, i will look into it and fix it.

tbh, gzipping responses should only be enabled for production usages (so is debugbar)

@erlandmuchasaj This is not a middleare priority issue?
I think the gzip middleware need to be always executed as last.
https://laravel.com/docs/11.x/middleware#sorting-middleware

@erlandmuchasaj This is not a middleware priority issue?
I think the gzip middleware need to be always executed as last.
https://laravel.com/docs/11.x/middleware#sorting-middleware

It might be, but i will need to debug and investigate further to test it and if needed update the readme doc.
Thanks @Pr3d4dor

Adding \ErlandMuchasaj\LaravelGzip\Middleware\GzipEncodeResponse::class to the 'web' middlwareGroup causes packages such a Spatie cookie consent and the laravel debug bar to not display anymore.

Its an ordering issue, you need to place the GzipEncodeResponse::class before CookieConsentMiddleware::class


Ascent rates go to infinity / -infinity during flight

We are seeing the ascent rate calculation ingest some bad number, such that the running calculation of ascent rate ends up at infinity. This is due to the 'infinite impulse response' averaging/filtering used at the moment, occurring here: https://github.com/projecthorus/sondehub-tracker/blob/master/js/tracker.js#L2727
A few approaches to fixing this:

Detect if the result of a calculation results in an invalid result (e.g +/- inf), and discard it.
Calculate the ascent rate over a fixed time window, so any bad values will shuffle out of the window eventually.

Detecting the +/- inf values is probably the better solution.

Also... I'm thinking this line needs an isFinite check: https://github.com/projecthorus/sondehub-tracker/blob/master/js/tracker.js#L2734
That might fix the issue entirely.

I've added this to testing: https://github.com/projecthorus/sondehub-tracker/commit/de4c2f365cf29a5cd05a69c9b06f3d82f0c06d23.
If it all works ok will merge to main.


fix for macOS unzip

Fixes: #973
Description

Thanks for merging this - but it still doesnt fix the symlink issue :)


Error with sharded Mixtral

System Info
128 gb RAM. On-premise machine with 2 GPUs.
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.147.05   Driver Version: 525.147.05   CUDA Version: 12.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A800 80G...  On   | 00000000:81:00.0 Off |                    0 |
| N/A   35C    P0    51W / 300W |      0MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A800 80G...  On   | 00000000:C1:00.0 Off |                    0 |
| N/A   35C    P0    52W / 300W |      0MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

Information

[X] Docker
[ ] The CLI directly

Tasks

[ ] An officially supported command
[X] My own modifications

Reproduction
docker run --gpus all \
    -e HF_HOME=/data \
    -e CUDA_VISIBLE_DEVICES=all \
    -e NCCL_IGNORE_DISABLED_P2P=1 \
    -e NCCL_P2P_DISABLE=1 \
    -e TRITON_LIBCUDA_PATH=/usr/local/cuda-12.1/compat/ \
    -v /storage/tf_cache/:/data \
    -p 8000:8000 \
    --rm \
    --ipc=host \
    --shm-size=100Gb \
    --name tgi_test \
    ghcr.io/huggingface/text-generation-inference:2.1.0 \
    --model-id OpenBuddy/openbuddy-mixtral-7bx8-v18.1-32k --trust-remote-code --port 8000 --hostname <IP_ADDRESS> --num-shard 2

Expected behavior
logs:
2024-06-28T11:20:19.574965Z  INFO text_generation_launcher: Args {
    model_id: "OpenBuddy/openbuddy-mixtral-7bx8-v18.1-32k",
    revision: None,
    validation_workers: 2,
    sharded: None,
    num_shard: Some(
        2,
    ),
    quantize: None,
    speculate: None,
    dtype: None,
    trust_remote_code: true,
    max_concurrent_requests: 128,
    max_best_of: 2,
    max_stop_sequences: 4,
    max_top_n_tokens: 5,
    max_input_tokens: None,
    max_input_length: None,
    max_total_tokens: None,
    waiting_served_ratio: 0.3,
    max_batch_prefill_tokens: None,
    max_batch_total_tokens: None,
    max_waiting_tokens: 20,
    max_batch_size: None,
    cuda_graphs: None,
    hostname: "<IP_ADDRESS>",
    port: 8000,
    shard_uds_path: "/tmp/text-generation-server",
    master_addr: "localhost",
    master_port: 29500,
    huggingface_hub_cache: Some(
        "/data",
    ),
    weights_cache_override: None,
    disable_custom_kernels: false,
    cuda_memory_fraction: 1.0,
    rope_scaling: None,
    rope_factor: None,
    json_output: false,
    otlp_endpoint: None,
    otlp_service_name: "text-generation-inference.router",
    cors_allow_origin: [],
    watermark_gamma: None,
    watermark_delta: None,
    ngrok: false,
    ngrok_authtoken: None,
    ngrok_edge: None,
    tokenizer_config_path: None,
    disable_grammar_support: false,
    env: false,
    max_client_batch_size: 4,
    lora_adapters: None,
}
2024-06-28T11:20:19.575029Z  INFO hf_hub: Token file not found "/data/token"
2024-06-28T11:20:19.576535Z  INFO text_generation_launcher: Model supports up to 32768 but tgi will now set its default to 4096 instead. This is to save VRAM by refusing large prompts in order to allow more users on the same hardware. You can increase that size using `--max-batch-prefill-tokens=32818 --max-total-tokens=32768 --max-input-tokens=32767`.
2024-06-28T11:20:19.576541Z  INFO text_generation_launcher: Default `max_input_tokens` to 4095
2024-06-28T11:20:19.576544Z  INFO text_generation_launcher: Default `max_total_tokens` to 4096
2024-06-28T11:20:19.576546Z  INFO text_generation_launcher: Default `max_batch_prefill_tokens` to 4145
2024-06-28T11:20:19.576548Z  INFO text_generation_launcher: Using default cuda graphs [1, 2, 4, 8, 16, 32]
2024-06-28T11:20:19.576551Z  WARN text_generation_launcher: `trust_remote_code` is set. Trusting that model `OpenBuddy/openbuddy-mixtral-7bx8-v18.1-32k` do not contain malicious code.
2024-06-28T11:20:19.576553Z  INFO text_generation_launcher: Sharding model on 2 processes
2024-06-28T11:20:19.576633Z  INFO download: text_generation_launcher: Starting download process.
2024-06-28T11:20:21.398471Z  INFO text_generation_launcher: Detected system cpu
2024-06-28T11:20:23.045399Z  INFO text_generation_launcher: Files are already present on the host. Skipping download.
2024-06-28T11:20:23.697443Z  INFO download: text_generation_launcher: Successfully downloaded weights.
2024-06-28T11:20:23.697672Z  INFO shard-manager: text_generation_launcher: Starting shard rank=0
2024-06-28T11:20:23.697685Z  INFO shard-manager: text_generation_launcher: Starting shard rank=1
2024-06-28T11:20:25.649885Z  INFO text_generation_launcher: Detected system cpu
2024-06-28T11:20:25.654759Z  INFO text_generation_launcher: Detected system cpu
2024-06-28T11:20:26.950985Z  WARN text_generation_launcher: Could not import Flash Attention enabled models: cannot import name 'FastLayerNorm' from 'text_generation_server.layers.layernorm' (/opt/conda/lib/python3.10/site-packages/text_generation_server/layers/layernorm.py)
2024-06-28T11:20:26.956319Z  WARN text_generation_launcher: Could not import Flash Attention enabled models: cannot import name 'FastLayerNorm' from 'text_generation_server.layers.layernorm' (/opt/conda/lib/python3.10/site-packages/text_generation_server/layers/layernorm.py)
2024-06-28T11:20:27.276862Z ERROR text_generation_launcher: Error when initializing model
Traceback (most recent call last):
  File "/opt/conda/bin/text-generation-server", line 8, in <module>
    sys.exit(app())
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 311, in __call__
    return get_command(self)(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 778, in main
    return _main(
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 216, in _main
    rv = self.invoke(ctx)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
    server.serve(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
    asyncio.run(
  File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 636, in run_until_complete
    self.run_forever()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 603, in run_forever
    self._run_once()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 1909, in _run_once
    handle._run()
  File "/opt/conda/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
> File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
    model = get_model(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 775, in get_model
    raise NotImplementedError(FLASH_ATT_ERROR_MESSAGE.format("Sharded Mixtral"))
NotImplementedError: Sharded Mixtral requires Flash Attention enabled models.
2024-06-28T11:20:27.281308Z ERROR text_generation_launcher: Error when initializing model
Traceback (most recent call last):
  File "/opt/conda/bin/text-generation-server", line 8, in <module>
    sys.exit(app())
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 311, in __call__
    return get_command(self)(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 778, in main
    return _main(
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 216, in _main
    rv = self.invoke(ctx)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
    server.serve(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
    asyncio.run(
  File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 636, in run_until_complete
    self.run_forever()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 603, in run_forever
    self._run_once()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 1909, in _run_once
    handle._run()
  File "/opt/conda/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
> File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
    model = get_model(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 775, in get_model
    raise NotImplementedError(FLASH_ATT_ERROR_MESSAGE.format("Sharded Mixtral"))
NotImplementedError: Sharded Mixtral requires Flash Attention enabled models.
2024-06-28T11:20:27.901622Z ERROR shard-manager: text_generation_launcher: Shard complete standard error output:

The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
Traceback (most recent call last):

  File "/opt/conda/bin/text-generation-server", line 8, in <module>
    sys.exit(app())

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
    server.serve(

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
    asyncio.run(

  File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)

  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
    model = get_model(

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 775, in get_model
    raise NotImplementedError(FLASH_ATT_ERROR_MESSAGE.format("Sharded Mixtral"))

NotImplementedError: Sharded Mixtral requires Flash Attention enabled models.
 rank=0
2024-06-28T11:20:27.901921Z ERROR shard-manager: text_generation_launcher: Shard complete standard error output:

The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
Traceback (most recent call last):

  File "/opt/conda/bin/text-generation-server", line 8, in <module>
    sys.exit(app())

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
    server.serve(

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
    asyncio.run(

  File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)

  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
    model = get_model(

  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 775, in get_model
    raise NotImplementedError(FLASH_ATT_ERROR_MESSAGE.format("Sharded Mixtral"))

NotImplementedError: Sharded Mixtral requires Flash Attention enabled models.
 rank=1
2024-06-28T11:20:28.001594Z ERROR text_generation_launcher: Shard 0 failed to start
2024-06-28T11:20:28.001605Z  INFO text_generation_launcher: Shutting down shards
Error: ShardCannotStart

I understand that this error is due to the fact that this module cannot be imported: https://github.com/huggingface/text-generation-inference/blob/main/server/text_generation_server/models/init.py#L53-L92
WARN text_generation_launcher: Could not import Flash Attention enabled models: cannot import name 'FastLayerNorm' from 'text_generation_server.layers.layernorm' (/opt/conda/lib/python3.10/site-packages/text_generation_server/layers/layernorm.py)

i found out that it is  my mistake.  in env -e CUDA_VISIBLE_DEVICES=0,1. But now I have another issue
docker run --gpus all \
    -e HF_HOME=/data \
    -e CUDA_VISIBLE_DEVICES=0,1 \
    -e NCCL_IGNORE_DISABLED_P2P=1 \
    -e NCCL_P2P_DISABLE=1 \
    -e TRITON_LIBCUDA_PATH=/usr/local/cuda-12.1/compat/ \
    -v /storage/tf_cache/:/data \
    -p 8000:8000 \
    --rm \
    --ipc=host \
    --shm-size=100Gb \
    --name tgi_test \
    ghcr.io/huggingface/text-generation-inference:2.1.0 \
    --model-id OpenBuddy/openbuddy-mixtral-7bx8-v18.1-32k --trust-remote-code --port 8000 --hostname <IP_ADDRESS> --num-shard 2

LOGS:
2024-06-28T11:27:02.183907Z  INFO text_generation_launcher: Args {
    model_id: "OpenBuddy/openbuddy-mixtral-7bx8-v18.1-32k",
    revision: None,
    validation_workers: 2,
    sharded: None,
    num_shard: Some(
        2,
    ),
    quantize: None,
    speculate: None,
    dtype: None,
    trust_remote_code: true,
    max_concurrent_requests: 128,
    max_best_of: 2,
    max_stop_sequences: 4,
    max_top_n_tokens: 5,
    max_input_tokens: None,
    max_input_length: None,
    max_total_tokens: None,
    waiting_served_ratio: 0.3,
    max_batch_prefill_tokens: None,
    max_batch_total_tokens: None,
    max_waiting_tokens: 20,
    max_batch_size: None,
    cuda_graphs: None,
    hostname: "<IP_ADDRESS>",
    port: 8000,
    shard_uds_path: "/tmp/text-generation-server",
    master_addr: "localhost",
    master_port: 29500,
    huggingface_hub_cache: Some(
        "/data",
    ),
    weights_cache_override: None,
    disable_custom_kernels: false,
    cuda_memory_fraction: 1.0,
    rope_scaling: None,
    rope_factor: None,
    json_output: false,
    otlp_endpoint: None,
    otlp_service_name: "text-generation-inference.router",
    cors_allow_origin: [],
    watermark_gamma: None,
    watermark_delta: None,
    ngrok: false,
    ngrok_authtoken: None,
    ngrok_edge: None,
    tokenizer_config_path: None,
    disable_grammar_support: false,
    env: false,
    max_client_batch_size: 4,
    lora_adapters: None,
}
2024-06-28T11:27:02.183972Z  INFO hf_hub: Token file not found "/data/token"
2024-06-28T11:27:02.185611Z  INFO text_generation_launcher: Model supports up to 32768 but tgi will now set its default to 4096 instead. This is to save VRAM by refusing large prompts in order to allow more users on the same hardware. You can increase that size using `--max-batch-prefill-tokens=32818 --max-total-tokens=32768 --max-input-tokens=32767`.
2024-06-28T11:27:02.185618Z  INFO text_generation_launcher: Default `max_input_tokens` to 4095
2024-06-28T11:27:02.185620Z  INFO text_generation_launcher: Default `max_total_tokens` to 4096
2024-06-28T11:27:02.185622Z  INFO text_generation_launcher: Default `max_batch_prefill_tokens` to 4145
2024-06-28T11:27:02.185624Z  INFO text_generation_launcher: Using default cuda graphs [1, 2, 4, 8, 16, 32]
2024-06-28T11:27:02.185628Z  WARN text_generation_launcher: `trust_remote_code` is set. Trusting that model `OpenBuddy/openbuddy-mixtral-7bx8-v18.1-32k` do not contain malicious code.
2024-06-28T11:27:02.185630Z  INFO text_generation_launcher: Sharding model on 2 processes
2024-06-28T11:27:02.185716Z  INFO download: text_generation_launcher: Starting download process.
2024-06-28T11:27:05.000830Z  INFO text_generation_launcher: Detected system cuda
2024-06-28T11:27:07.021516Z  INFO text_generation_launcher: Files are already present on the host. Skipping download.
2024-06-28T11:27:07.698392Z  INFO download: text_generation_launcher: Successfully downloaded weights.
2024-06-28T11:27:07.698638Z  INFO shard-manager: text_generation_launcher: Starting shard rank=0
2024-06-28T11:27:07.698639Z  INFO shard-manager: text_generation_launcher: Starting shard rank=1
2024-06-28T11:27:10.655958Z  INFO text_generation_launcher: Detected system cuda
2024-06-28T11:27:10.749024Z  INFO text_generation_launcher: Detected system cuda
2024-06-28T11:27:17.706926Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:27:17.707165Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:27:27.720205Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:27:27.740447Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:27:37.806208Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:27:37.812606Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:27:47.900818Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:27:47.904761Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:27:57.915449Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:27:57.916446Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:28:07.924304Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:28:07.939241Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:28:17.995423Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:28:18.012241Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:28:28.012532Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:28:28.102771Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:28:38.027759Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:28:38.117450Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:28:48.100639Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:28:48.207074Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:28:58.114913Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:28:58.220436Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:08.131400Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:29:08.239067Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:18.218077Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:29:18.319564Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:28.227565Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:29:28.329419Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:38.307420Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:29:38.342966Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:48.402267Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:29:48.412476Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:58.422970Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:29:58.423067Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:30:08.501083Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:30:08.525819Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:30:18.526233Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:30:18.619383Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:30:28.606955Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:30:28.711349Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:30:38.666041Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:30:38.771558Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:30:48.717671Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:30:48.883301Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:30:58.769347Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=1
2024-06-28T11:30:58.887333Z  INFO shard-manager: text_generation_launcher: Waiting for shard to be ready... rank=0
2024-06-28T11:31:04.854994Z ERROR text_generation_launcher: Error when initializing model
Traceback (most recent call last):
  File "/opt/conda/bin/text-generation-server", line 8, in <module>
    sys.exit(app())
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 311, in __call__
    return get_command(self)(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 778, in main
    return _main(
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 216, in _main
    rv = self.invoke(ctx)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
    server.serve(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
    asyncio.run(
  File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 636, in run_until_complete
    self.run_forever()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 603, in run_forever
    self._run_once()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 1909, in _run_once
    handle._run()
  File "/opt/conda/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
> File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
    model = get_model(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 766, in get_model
    return FlashMixtral(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mixtral.py", line 22, in __init__
    super(FlashMixtral, self).__init__(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mistral.py", line 97, in __init__
    super().__init__(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_causal_lm.py", line 822, in __init__
    super(FlashCausalLM, self).__init__(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/model.py", line 63, in __init__
    self.target_to_layer = self.adapter_target_to_layer()
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mistral.py", line 156, in adapter_target_to_layer
    if hasattr(layer.mlp, "gate_up_proj"):
  File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1709, in __getattr__
    raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
AttributeError: 'MixtralLayer' object has no attribute 'mlp'
2024-06-28T11:31:04.857312Z ERROR text_generation_launcher: Error when initializing model
Traceback (most recent call last):
  File "/opt/conda/bin/text-generation-server", line 8, in <module>
    sys.exit(app())
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 311, in __call__
    return get_command(self)(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 778, in main
    return _main(
  File "/opt/conda/lib/python3.10/site-packages/typer/core.py", line 216, in _main
    rv = self.invoke(ctx)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/typer/main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
    server.serve(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
    asyncio.run(
  File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 636, in run_until_complete
    self.run_forever()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 603, in run_forever
    self._run_once()
  File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 1909, in _run_once
    handle._run()
  File "/opt/conda/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
> File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
    model = get_model(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 766, in get_model
    return FlashMixtral(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mixtral.py", line 22, in __init__
    super(FlashMixtral, self).__init__(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mistral.py", line 97, in __init__
    super().__init__(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_causal_lm.py", line 822, in __init__
    super(FlashCausalLM, self).__init__(
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/model.py", line 63, in __init__
    self.target_to_layer = self.adapter_target_to_layer()
  File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mistral.py", line 156, in adapter_target_to_layer
    if hasattr(layer.mlp, "gate_up_proj"):
  File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1709, in __getattr__
    raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
AttributeError: 'MixtralLayer' object has no attribute 'mlp'
2024-06-28T11:31:08.060487Z ERROR shard-manager: text_generation_launcher: Shard complete standard error output:

The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama_fast.LlamaTokenizerFast'>. This is expected, and simply means that the `legacy` (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set `legacy=False`. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[rank0]: Traceback (most recent call last):

[rank0]:   File "/opt/conda/bin/text-generation-server", line 8, in <module>
[rank0]:     sys.exit(app())

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/cli.py", line 106, in serve
[rank0]:     server.serve(

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 297, in serve
[rank0]:     asyncio.run(

[rank0]:   File "/opt/conda/lib/python3.10/asyncio/runners.py", line 44, in run
[rank0]:     return loop.run_until_complete(main)

[rank0]:   File "/opt/conda/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
[rank0]:     return future.result()

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/server.py", line 231, in serve_inner
[rank0]:     model = get_model(

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/__init__.py", line 766, in get_model
[rank0]:     return FlashMixtral(

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mixtral.py", line 22, in __init__
[rank0]:     super(FlashMixtral, self).__init__(

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mistral.py", line 97, in __init__
[rank0]:     super().__init__(

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_causal_lm.py", line 822, in __init__
[rank0]:     super(FlashCausalLM, self).__init__(

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/model.py", line 63, in __init__
[rank0]:     self.target_to_layer = self.adapter_target_to_layer()

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_mistral.py", line 156, in adapter_target_to_layer
[rank0]:     if hasattr(layer.mlp, "gate_up_proj"):

[rank0]:   File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1709, in __getattr__
[rank0]:     raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")

[rank0]: AttributeError: 'MixtralLayer' object has no attribute 'mlp'
 rank=0
2024-06-28T11:31:08.079185Z ERROR text_generation_launcher: Shard 0 failed to start
2024-06-28T11:31:08.079210Z  INFO text_generation_launcher: Shutting down shards
2024-06-28T11:31:08.159265Z  INFO shard-manager: text_generation_launcher: Terminating shard rank=1
2024-06-28T11:31:08.159383Z  INFO shard-manager: text_generation_launcher: Waiting for shard to gracefully shutdown rank=1
2024-06-28T11:31:08.860057Z  INFO shard-manager: text_generation_launcher: shard terminated rank=1
Error: ShardCannotStart

https://github.com/huggingface/text-generation-inference/pull/2123 I will wait this MR

Hi just to confirm I get the same AttributeError: 'MixtralLayer' object has no attribute 'mlp' error on alpindale/WizardLM-2-8x22B with the latest Docker.

I am also getting this error on Mixtral-8x22B-Instruct-v0.1, however, it was working fine until 2.0.4 release.

I am also getting this error on Mixtral 8x7B, was fine on 2.0.4, fails on 2.1.0

After merge #2123 all right. You can test on this image: https://github.com/huggingface/text-generation-inference/pkgs/container/text-generation-inference/239248617?tag=sha-4dfdb48


XML cleaning code is not practical

immense docker image and hard to run

This can be closed now I think


add SSL option to tweet-button

Thanks for this neat little wrapper gem, it was handy.  If you're interested, the modification I added here allows you to specify ":ssl=>true" in the "custom_tweet_button" method so if your web app is all SSL, you can still make use of the gem.

Wouldn't protocol neutral urls be simpler and give the same results.
E.g. //twitter.com/share
and //platform.twitter.com/widgets.js
Got it here:
https://github.com/eimermusic/tweet-button/commit/370534ee14f2fbafd8e41bb887ebc044bb602801

+1 to protocol-relative urls


Provide a way to censor credentials in report if wanted

I utilize the slack api to post our html reports generated by our projects to slack channels. However, it is a security concern since the username and password of test accounts are exposed.
Is there a way/become a way to censor the string credentials, especially in "set up" steps?

I believe that censoring sensitive information is out of scope of this tool because of these reasons:

If you have user/passwords in your logs (in xcresults file) that is also a security breach so it should be addressed before logging that information. Please consider using OSLog with new private and public modifiers  https://developer.apple.com/forums/thread/118819

Same principle applies for screenshots however there is not built in API that hides the sensitive info (not at least that I am aware of). This task should be done by the application logic. Framework logic (this tool) has no information about what info is sensitive/non-sensitive.

I would close this issue but if you feel that we should discuss more re-open please.


[VCX] Merge vcx

Merge VCX library inside of indy-sdk repo

@dkulic Do you have any design documents about this?

Currently only
vcx/README.md
vcx/docs/vcx_arch.md
and  Libvcx integration HIPE #29
but we plan to add more.


Add .#{ime} and #{number} syntax

Depends on https://github.com/liveview-native/live_view_native_stylesheet/pull/34.
Adds support for:
  "button-" <> style do
    buttonStyle(.#{style})
  end

  "h-" <> height do
    height(#{height})
  end

Which lets us do:
<Button class="h-16 button-bordered"> ... </Button>

I'd like to get @carson-katri 's thoughts on this

Reopening as @NduatiK will update the syntax to {...}
This shoudl be such that wraping in the moustache syntax is now a requirement for interpolating values into the AST. For example:
"foobar-" <> foobar do
   barbaz(foobar)
end

should no longer be valid. Instead it must be:
"foobar-" <> foobar do
   barbaz({foobar})
end

so if the class match is "red" it would then be parsed as if the value is injected directly into the rules as:
barbaz(red)

Any type of changes to the value will require an external wrap, for example for strings:
"foobar-" <> foobar do
   barbaz("{foobar}")
end

will now result in:
barbaz("red")

and to cover to the dot-notation:
"foobar-" <> foobar do
   barbaz(.{foobar})
end

gives us
barbaz(.red)

and this will then be parsed into our AST node.

Small correction, the following would be valid and should compile:
"foobar-" <> foobar do
   barbaz(foobar)
end

but it would compile to:
barbaz(foobar)

I think requiring "{variable}" adds too much friction for simple use cases. I think most developers would expect this to resolve to modifier("whatever the value is"):
"my-class-" <> variable do
  modifier(variable)
end

Then the {...} syntax lets you do something else with that string variable.

That would be similar to how I can use variables from ~RULES:
variable = "test"
~RULES"""
modifier(variable)
"""

I would expect the value of variable to be used here, not the name of the variable.

Sounds like the only change is to support .{variable}.

Small correction, the following would be valid and should compile:
"foobar-" <> foobar do
   barbaz(foobar)
end

but it would compile to:
barbaz(foobar)

By default, variables from the block head are strings.
"foobar-" <> foobar do
   barbaz(foobar)
end

will inject the value of foobar into the AST as a string so there's no need to separate foobar and "{foobar}".

@carson-katri what we want to do is move closer to what the HEEX templates provide within our own template. This would require us to use interpolation for any value injection into the template. Otherwise the text should be treated as a literal and not interpolated.

@bcardarella, could we avoid faking interpolation for now? It introduces quite a bit of complexity for something we are planning to change soon.

If this is something we must have, we need to consider how we handle integers and floats
"foobar-" <> foobar do
   barbaz({to_float(foobar)})
      # OR
   barbaz({foobar})
end

@bcardarella I don’t think these need to behave exactly the same. In a HEEx template, you’re interpolating values that exist outside the normal markup syntax. If the variable declaration happened in a separate nested language (like nesting elixir in markup), then interpolation would make sense. But here, the variable is declared within the stylesheet, so I would expect it could be used directly.

@carson-katri right but that's exactly what is happening here. The ~SHEET sigil of:
"color-" <> color do
   color(.{color})
end

compiles to:
def class("color-" <> color, _target) do
   ~RULES"""
   color(.{color})
   """
end

The ~SHEET sigil is just a convenience DSL

@NduatiK putting the literal into the document means we don't need a way to typecast. The parsing would happen on the text after the interpolation.
<Text class="size-12">Hello</Text>

"size-" <> size do
   fontSize({size})
end

after interpolation the rule will look like:
fontSize(12)

this should hold up for floats as well:
<Text class="size-12.4">Hello</Text>

fontSize(12.4)

Implementing real interpolation is not easy. For the v0.2 release, I can implement a parser that convert the following:

Stylesheet
Result

"{ variable }"
ast(variable)

{ variable }
ast(to_number(variable))

.{ variable }
ast(to_ime(variable))

to_number is implemented as shown here

@bcardarella, any feedback on this?

@NduatiK I plan on circling back this week hopefully after I've completed my refactor for render_with integration. Sorry for the delay 😞

No problem, just wanted to make sure we aren't both waiting on each other🙃

I believe this is no longer valid given https://github.com/liveview-native/live_view_native_stylesheet/pull/42


Fix NVIC deprecation warnings, bump version

This is a breaking change, because EXTI API is changed.

@arkorobotics could you review this? I'd like to bump stm32-usbd dependencies and stm32l0xx-hal  is the only hal I wait for.

The version bump to 0.3.0 is a large leap. If anything, we'd bump it from 0.2.0 to 0.2.1.
As for the NVIC changes, they look good to me at a quick glance, but I would like @hannobraun to review it before pulling.

I've taken a short look and can't see any issues. Seems fairly non-controversial, as it just replaces deprecated functions with their replacements. The only thing I'd look into is why NVIC::unmask is unsafe, and how that matches our usage.
I don't have time to take a closer look right now. I'm on vacation and will be back in the office on September 9.

The version bump to 0.3.0 is a large leap. If anything, we'd bump it from 0.2.0 to 0.2.1.

I'm pretty sure I've made breaking changes since the last release. This would require a bump to 0.3.0 per semantic versioning.

At least stm32l0 dependency update is a breaking change: https://github.com/stm32-rs/stm32l0xx-hal/commit/e8a6522fb03749c550fbd4a38ac81be76936cca9

Copy that. I'll merge this and bump to version 0.3.0.

@Disasm This merge has been rolled into 0.3.0. Please let me know if there are any issues https://crates.io/crates/stm32l0xx-hal


Refactoring the Generic Context Menu to just be an activator wrapper

Added the ContextMenuService
Finished the ContextMenuService
Missed the custom attributes on the context menus
Forgot to await the import js file task
Refactoring the Generic Context Menu to just be a an activator wrapper

ope, merge conflict

ope, merge conflict

Yeah just rebased, should be good now


Impersonation Status for authkit-react?

Hello. The readme says that Impersonation support is on the roadmap for this library for 2024. Is it still in the roadmap? Any timeline for when we could expect it?

hey @robertkrossa , impersonation is high on the roadmap but we haven't picked it up yet. 2024 is not likely but it should be coming "soon." (i'm hesitant to provide a more specific date).

Thanks @cmatheson. Just a data point that it would be useful for me and my team


Bedrock API review

Connections layer rename
Microsoft.AspNetCore.Http.Connections
Microsoft.AspNetCore.Http.Connections.Common
Microsoft.AspNetCore.Http.Connections.Client
app.UseConnections(routes =>
{
    // Handle SignalR chat connections on the /chat path (multiple transports)
    routes.MapConnection("chat", connectionBuilder =>
    {
        connectionBuilder.UseSignalR<Chat>();
    });
});

Cleanup

Rename DefaultConnectionContext to something else
Remove Microsoft.AspNetCore.Sockets.Abstractions

We need to delete Sockets.Abstractions but IConnection is the last remaining hold out once we do the renames.

Blocked on #1475

This is done


Class-names displaying in lower-case?

Example:
$ /C/workspace/test/etsy-phan/phan *.php Facets/*.php
Field.php:89 UndefError reference to undeclared class \Kodus\Forms\Validators\isrequired
InputRenderer.php:558 TypeError arg#2(attr) is float|int but \Kodus\Forms\inputrenderer::tag() takes array defined at InputRenderer.php:241

These class-names are actually IsRequired and InputRenderer, how come the case is being folded to lower-case in these error-messages?
(Neither filenames, nor declarations, nor usages refer to these in lower-case.)

duplicates #43

Closing this as a duplicate.

For the record, I searched first, but there is no real issue description in #43

@mindplay-dk Thanks for that. I updated the title on #43 before closing this issue out to make the issue more clear.


portico: Revamp /for/open-source.

Pushing for my convenience only; do not review.

Testing plan:
GIFs or screenshots:

It looks like we have some broken links, but otherwise this looks great; fixed and merged.  Thanks @alya and @eeshangarg!


Add guide from useetv.com

Closes #657
Note: Next day schedule is unavailable, only today and past days, so automatic workflow for this site should run earlier (maybe at 00:15 AM UTC +7) to avoid blank EPG for few hours.

I think no one will respond to this :v


Connection breaks down after a while

The WebSocket connection will break down after some time. This leads to "Failure to connect to server" messages. A page refresh fixes it.
I suspect this to be the source of errors like #153 or "Unknown error".

I have experienced this a couple times today, didn't catch on that it was a simple refresh fixing it. The red icon at the top left appears to keep spinning even once the error output returns

Happens to me all the time. Usually a refresh fixes it, sometimes it doesn't.

Closing old issue. Please open a new one if this issue is still there.


Transition error if transition.params === null,

Line 73 is checking if the transition is a single resource, if so doing the mixin is doing a  transition and passing transition.params, but if those params are null, there is a transition error:
Uncaught Error: More context objects were passed than there are dynamic segments for the route:
I don't know if this is the ideal fix, but it's working for me.

Thanks for your contribution, could you accompany this PR with some specs that test the scenario's you mentioned in #4 ?

No problem, I have updated.

thanks again for your contribution i made a few small changes and merged it.

My pleasure thanks for the great addon!
On Wed, May 27, 2015 at 6:55 AM, Alexander Jeurissen <
<EMAIL_ADDRESS>wrote:

thanks again for your contribution i made a few small changes and merged
it.
—
Reply to this email directly or view it on GitHub
https://github.com/alexanderjeurissen/ember-cli-history-mixin/pull/5#issuecomment-105846583
.


Add code-coverage-tools package to compare code coverage on the PR build.

Description
AB#14170
Add code-coverage-tools package to compare code coverage on the PR build.
1.) Before running coverage comparison, code coverage plugin identifies the baseline build for the PR.
2.) Once the baseline build is identified, we download the build artifacts corresponding to the codeCoverageAnalysis artifact name for this build
3.) We then collect the code coverage stats for the PR build and then make the comparison with the baseline.
4.) If the code coverage diff (line or branch coverage) is more than a percentage point change, then we fail the build for the PR. We also fail the build in case the code coverage for the newly added package is less than 50%.
5.) We post the comment on the PR specifying the code coverage change if any for each package which is modified.
Sample Comment:

@tylerbutler Please take another pass on it as you had requested some changes on this PR.

Nit: it would probably be good to call out in the PR description why we needed to create our own coverage infrastructure, rather than using an off-the-shelf solution.


Youtube/vimeo video url can be remote_url?

Why
FFMPEG::Movie.new("https://www.youtube.com/watch?v=holhZM1OpTc")
throws ,
does not exist
can we pass youtube remote video url?

Hi @poussy
I am also trying to implement the same. Were you able to get any solution?
Thanks

Hi, I'm facing the same issue.  Were you able to get any solution?


Capture _shard_stores

https://www.elastic.co/guide/en/elasticsearch/reference/master/indices-shards-stores.html
Could be handy to have that in a json file.

Added a while back.


build(flux): update flux to v0.143.0

This is failing in CI, gonna try again now that influxdata/flux#4292 has merged.


Strptime format error

An exception occurred while processing one of the videos:
...\lib\site-packages\pyvod\vodchat.py", line 148, in get_comments     _comment_datetime = datetime.strptime(created_at
...
ValueError: time data '2021-09-09T20:15:52.40990439Z' does not match format '%Y-%m-%dT%H:%M:%S.%fZ'
It may be worth replacing datetime.strptime() with dateutil.parser.parse()

Hello @wishes90,
sorry for the delayed response.
First of all though, thank you for pointing this issue out, I will look into it! 👍

Hey @wishes90,
I have made a fix for this issue and also opened a pull request #4 for it as well (branch ISSUE-3).
In order to get the changes from that branch, you can simply install pyvod-chat via

pip install git+https://github.com/sixP-NaraKa/pyvod-chat.git@ISSUE-3
or maybe your other preferred ways (like cloning the repo)

If that shouldn't get you the changes (didn't for me), you might need to pip uninstall pyvod-chat first, and then rerun the above command. 👍
Could you test with the VOD ID with which it previously failed and notify me of the result? Would be appreciated.
Thanks!


TimeUtils Error

On line 52 BaseLoader.getPlugin().getBaseSettings().dateTimeFormat() throws "Cannot find symbol" and on line 58 BaseLoader.getPlugin().getBaseSettings().dateFormat() throws "Cannot find symbol". My IDE is IntelliJ. This is probably my fault, let my know if it is :D

Have you tried updating to 1.6.0-SNAPSHOT?

I have updated, I'm on the most recent version. I created a script to update it for me.

I download the version approximately 30 minutes ago by the way.

Try Maven -> Reimport Project and Build -> Rebuild Project

I can't find this in IntelliJ, does it help you knowing that I just download the repo, copy the dev folder (from pluginbase-core) into my project? Is there a better way to do it?

Can you screenshot the error?

Here :D

The error doesn't originate from my code by the way, I'm not even using TimeUtils :\

I can only suggest re-downloading the library since the methods do exist...

It seems the problem is with my downloader script, is there any other way to get the library? Is it, for example, on maven?

You can try using JitPack (and selecting the "Commits" tab). https://jitpack.io/#Demeng7215/PluginBase

Thanks! Is there any easy way to make it get the most recent release?

Not that I'm aware of

Okay! I'll see if it works :D

It looks like it's worked, thanks!

I found something else, I've put it in this issue, I'll now close this one :D


No such file or directory: 'pretrained_14res/temp_data/pred_out.json'

Installed it successfully in MAC OS but getting the error pred_out.json not found. Not sure why is this working successfully in colab but not when I am installing it in my local machine. Can any one help me . I have downloaded the folder correctly. Contains all the required files. I have tried with 14lap and 14res but both have same issue.

Hi, when running on Mac without GPU, you can refer to this thread: https://github.com/chiayewken/Span-ASTE/issues/21#issuecomment-1191516824


Update setup.py

relax flask version. we have been running it with flask 2.X with no issue.

superseded by #99


feat(doctor): warn if a plugin overwrites a core plugin

Adding a doctor check to warn if a plugin overrides a core plugin. Overridden plugins might lead to issues if the used (external) plugin is no longer maintained for example or if the plugin is a migration left over from an earlier mise/rtx version.
Resolves #1876.

Could we instead just make this a warning instead of an error?

Yes we could rename checks to errors and introduce a warnings which is formatted with orange/yellow color and show this in a warnings summary.


Write-Warning for Begin Plugin Processing?

This is a "Did you really intend to do that?" kind of question.
When you replaced all of the Write-Host commands, you changed the "Begin Plugin Processing" output to a warning (line 720).  Was that intentional?  If so, you didn't change the completion output to a warning (e.g., ...Sending Email, ...Displaying HTML results, etc.).
What makes sense to me would be to change "Begin Plugin Processing" from a warning to Write-CustomOut.

I believe it would be part of #181 to remove Write-Host. I suspect it was changed to write-warning because of the colouring of the text- we should probably just change it to Write-CustomOut, Write-Output, or even Write-Verbose


When polling at 100ms, eventually start getting 'Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.'

Do you guys have plans of implementing this with callbacks so that the application running the module can make sure not to call again until the previous has returned?
Using the async module and altering the example a bit with:
conn.addItems('TEST9');

    async.forever(
        function(next) {
            //conn.readAllItems(valuesReady);

            conn.readAllItems(function (err, values) {
                if (err) { console.log("SOMETHING WENT WRONG READING VALUES!!!!"); }
                console.log(values);
                doneReading = true;
                if (doneWriting) { process.exit(); }
            });

            setTimeout(function () {
                next();
            }, 100);
        },
        function(err) {
            console.log('ERROR: ' + err);
        }
    );

After a few seconds of running I continue to get this:
{ TEST9: 4 }
[17439,716142848] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
[17439,716207848] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
[17439,716244339] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
[17439,716670828] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
{ TEST9: 16 }
[17439,817173683] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
[17439,817237162] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
[17439,817270232] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
[17439,817303682] Waiting to read for all R/W operations to complete.  Will re-trigger readAllItems in 100ms.
{ TEST9: 2 }

We've always found it best to call "next" from within the callback, just a few lines up, rather than from a setTimeout, or even if you call the timeout from within the callback if you want to avoid continuous polling, it should avoid the message you're seeing.

Wow... must be getting late in the day. Thanks for pointing that out.
Module looks great by the way.


Add basic DANDI metadata "extraction"

Not even really extraction since we will just load stored in DataLad dandisets .yaml (and later .json files for assets).
TODO:

[ ] replace prototyped code with proper python (asset level metadata -- postpone for now)
[ ] deploy and see what happens -- in principle we should also be able to search through dandisets

This PR is replaced by #257.


Kousa/isaac/eliminates room session gen registry

step 1 in making kousa gen_servers more OTP compliant

plz double check - i'm slightly unsure of that the join_room contract is satisfied; i feel like it should be returning userId but instead it returns a full user struct.

the frontend needs to entire user data

we could make it return just the user id but then every client will just make another request to get user details


Feature/issue 47 aws iam certificate

Adds support for certificates stored in IAM for issue #47

Thanks @imacube, going to take a look at this later today.

@joshrosso No problem. I shouldn't have missed the ACM lines and I'm still getting used to go's variable name formatting.

@imacube, just fyi I haven't forgot about this.
Just haven't had the cycles yet to test it out. I will as soon as possible and get back to you.
Thanks for the quick fixes based on comments!

@imacube Sorry for the crazy delay.
Really hoping to merge this today.
The glide.yaml needs to be updated to include IAM, subsequently we also need the glide.lock, and vendor/ re-committed once upgraded.

@imacube, thanks!

@joshrosso I'm seeing a build error I've not encountered before, go wants github.com/spf13/pflag from within vendor/k8s.io/ingress/vendor/github.com/spf13/pflag, but github.comspf13/pflag still exists in vendor/github.com/spf13/pflag. Not sure how to fix this.
CGO_ENABLED=0 GOOS=linux GOARCH=amd64 GOARM=6 go build -a -installsuffix cgo -ldflags '-w' -o server ./main.go
# github.com/coreos/alb-ingress-controller/controller
controller/controller.go:43: cannot convert ac (type *ALBController) to type ingress.Controller:
	*ALBController does not implement ingress.Controller (wrong type for OverrideFlags method)
		have OverrideFlags(*"github.com/coreos/alb-ingress-controller/vendor/github.com/spf13/pflag".FlagSet)
		want OverrideFlags(*"github.com/coreos/alb-ingress-controller/vendor/k8s.io/ingress/vendor/github.com/spf13/pflag".FlagSet)
controller/controller.go:43: impossible type assertion:
	*ALBController does not implement ingress.Controller (wrong type for OverrideFlags method)
		have OverrideFlags(*"github.com/coreos/alb-ingress-controller/vendor/github.com/spf13/pflag".FlagSet)
		want OverrideFlags(*"github.com/coreos/alb-ingress-controller/vendor/k8s.io/ingress/vendor/github.com/spf13/pflag".FlagSet)
make: *** [server] Error 2

@imacube, if you flatten the dependencies using -v  with glide install / update it'll flatten the vendoring, which appears to be the root issue.
http://glide.readthedocs.io/en/latest/commands/#glide-update-aliased-to-up
Let me know if this helps.

@joshrosso Thanks! The -v fixed the problem.

Brought up to date with rebase so IAM code shares aws session introduced in #99.

@imacube Great work and thanks for your patience.


AMBARI-22893: Update rat check rules for stack files (jluniya)

What changes were proposed in this pull request?
Update rat check rules to not be restrictive of stack paths.
How was this patch tested?
mvn clean apache-rat:check
Please review Ambari Contributing Guide before opening a pull request.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/378/
Test FAILed.
Test FAILured.


support termux

https://wiki.termux.com/wiki/Termux-clipboard-get
https://wiki.termux.com/wiki/Termux-clipboard-set

+1, Termux support would be great

I hadn't heard of termux's API before, but I wouldn't be opposed to supporting this behind an opt-in feature flag. Would that be sufficient for your needs?
I don't think this could be the default because I do want to add proper Android clipboard support eventually (#56), but again the feature flag could work.

A feature flag sounds good, yeah

This is going to be very low priority for me to implement, but I would review a PR that cleanly overrode the "platform clipboard" with a tmux implementation based on the discussed feature flag if anyone is interested in contributing.

I also encountered this problem.
❯ cargo check
    Checking arboard v3.3.2
error[E0433]: failed to resolve: could not find `Clipboard` in `platform`
  --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:76:38
   |
76 |         Ok(Clipboard { platform: platform::Clipboard::...
   |                                            ^^^^^^^^^ could not find `Clipboard` in `platform`

error[E0433]: failed to resolve: could not find `Clear` in `platform`
   --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:156:31
    |
156 | ...rm::Clear::new(&mut self.platform) }
    |        ^^^^^ could not find `Clear` in `platform`

error[E0433]: failed to resolve: could not find `Get` in `platform`
   --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:161:29
    |
161 | ...form::Get::new(&mut self.platform) }
    |          ^^^ could not find `Get` in `platform`

error[E0433]: failed to resolve: could not find `Set` in `platform`
   --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:166:29
    |
166 | ...form::Set::new(&mut self.platform) }
    |          ^^^ could not find `Set` in `platform`

error[E0412]: cannot find type `Clipboard` in module `platform`
  --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:65:33
   |
65 |     pub(crate) platform: platform::Clipboard,
   |                                    ^^^^^^^^^ not found in `platform`

error[E0412]: cannot find type `Get` in module `platform`
   --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:173:33
    |
173 |     pub(crate) platform: platform::Get<'clipboard>,
    |                                    ^^^ not found in `platform`

error[E0412]: cannot find type `Set` in module `platform`
   --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:197:33
    |
197 |     pub(crate) platform: platform::Set<'clipboard>,
    |                                    ^^^ not found in `platform`

error[E0412]: cannot find type `Clear` in module `platform`
   --> /data/data/com.termux/files/home/.cargo/registry/src/rsproxy.cn-0dccff568467c15b/arboard-3.3.2/src/lib.rs:238:33
    |
238 |     pub(crate) platform: platform::Clear<'clipboard>,
    |                                    ^^^^^ not found in `platform`

Some errors have detailed explanations: E0412, E0433.


MGMT: Retrieve list of supported service properties from server

I noticed that we now have:
options: PropertyOption[] = [
    new PropertyOption('wsfed.relyingPartyIdentifier','WS-Fed Relying Party Identifier','custom-identifier'),
    new PropertyOption('jwtAsResponse','JWT As Response','true'),
    new PropertyOption('jwtSecretsAreBase64Encoded','JWT Secrets Base 64 Encoded','false'),
    new PropertyOption('jwtEncryptionSecretMethod','JWT Encryption Secret Method','A192CBC-HS384'),
    new PropertyOption('jwtEncryptionSecretAlg','JWT Encryption Secret Alg','dir'),
    new PropertyOption('jwtSigningSecretAlg','JWT Signing Secret Alg', 'HS256'),
    new PropertyOption('jwtSigningSecret','JWT Signing Secret','<SECRET>'),
    new PropertyOption('jwtEncryptionSecret','JWT Encryption Secret','<SECRET>')
  ];

Given the list of props are continue to grow and each individual prop may be removed, refactored or even renamed, it would be better if there was some kind of an endpoint to retrieve the list of supported properties. Perhaps FormData needs to be extended to include the supported list and the UI would then use that instead of hardcoding/duplicating props.
I'm working on a deployment that is going to extend jwtAsResponse and make it fancier with a few additional props and I would like to reduce the maintenance work on the UI side as much as possible.

Sounds good.

Sweet. I'll move the collection of settings into an API that can be accessed via the management webapp and keep all in one place. I'll post back when it's done.

Please pull from apereo/cas:master once. There is now an enum RegisteredServiceProperties in RegisteredServiceProperty that lists all supported settings. This is available at the API level and you can use it as RegisteredServiceProperty.RegisteredServiceProperties.values() or some such in the management backend to automate the addition of new properties.
Note that I deprecated one property, and added two more. (You don't need to filter the deprecated one). List all for now.

Take a look at what I have pushed into mgmt-properties.  This is a WIP.  I need to refactor some of your code to get what I think we wanted.

Cool. I'll turn this into a PR so I can review/compare changes easily. Ping when ready.
And thanks very much, as always!

I went all out on this refactored all of the hard coded options out of the client code and made them part of the /formData end point.  This should make keeping the client up to date much easier.  I think everything is coded, just need to clean it up and document before pushing again.

Finished this up and pushed to mgmt-properties.  Take a look and let me know if we need to change anything.

Had a look.
The collection of enums that are now added to API classes are not going to work because they actually increase maintenance in ways that are forcibly very much manual and somewhat hidden. It seems like all new enums are more or less related to the management webapp functionality and as such don't belong in API classes necessarily, but more importantly, their design defeats the purpose of automation and polymorphism. For instance, if I add a new RegisteredService type, or if a new algorithm is added for signing/encryption or if a new MFA provider is added, one would then need to manually update all relevant enums and worse, one would need to remember to manually update enums. The fact that I have just added a provider or a new algorithm is not enough on its own and contributors are required to be mindful of extraneous places in the code to indicate the addition of a new type. It's very easy to forget these because there is nothing in the code or automated check to ensure such changes are comprehensive.
The same logic does not apply to the collection of properties defined because that enum/collection is the reference for all supports properties. Then only place you need to touch to introduce a new official property is that enum.
I understand the intention behind the change; I think this sort of thing is the perfect example of automating the behavior of management webapp based on what is supported in the running server. We'd need some kind of a discovery endpoint that would outline essentially two categories of metadata:

Things that are supported in general/theory.
Things that are actively configured and running.

Such that by querying this endpoint you could see:

What are set of services supported by this CAS server?
What set of services could be supported by this CAS server?

So on and so forth....and surely, this would remove the need for static hard coding of types and their relevance.
Also, certain bits that are included in these enums are not relevant for an enum. For example, if I call upon a Provider for MFA, that instance should immediately tell me its (friendly) name right there. I shouldn't have to check some outside enum to see what the name is, or any other relevant bits and pieces. Many of these settings could simply be reformatted to have them benefit from basic polymorphic behavior.
For the time being, I suggest you refactor the change with the following:

Remove all enums from API classes and move them over the management app.
Place/design them in the management app such that they can, later on, be removed easily and replaced with the contents of the profile endpoint when you query the server.

I'll continue to work on the discovery endpoint; I am not sure we'd be able to let the change go into 5.2, but perhaps some small foundational work to expose data would be good as a starting point for now and I'll focus on that piece for the time being.

Here's a quick mock-up of the change, as WIP:

All good points.  I have removed the enums that I added to the APIs.  I am
still using the ones that were already there to populate FormData.  I have
coded the other options not found else where in the code directly into the
FormData.  We can re-hash this later when the endpoint is coded.
Travis
On Mon, Oct 30, 2017 at 3:14 AM Misagh Moayyed<EMAIL_ADDRESS>wrote:

Here's a quick mock-up of the change, as WIP:
[image: image]
https://user-images.githubusercontent.com/1205228/32165529-5573d434-bd78-11e7-84bf-553dedc216e3.png
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/Unicon/cas/issues/62#issuecomment-340400465, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AS0kvSjK1ufPWUcgGtQAaoicyOuPMqdsks5sxaFogaJpZM4QHn6I
.

Excellent. Merged.


⚠ Jenkins Plugins Artifactory has degraded performance

In ad251e2, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1292 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 3920696 after 6 hours, 2 minutes.


multiple calendars

I love the sync implementation, its working fine, thank your for that! Now I can use it with the android app tasks.org
with tasks, i am used to sort tasks in different calendars, such as "work", "private", "home", whatever. do you think you could provide a way to easily switch between calendar lists?

I'm working on that right now :) It will be added in 45.1 release.

Awesome! Thank you:)
Am 29. Oktober 2023 20:00:42 MEZ schrieb mrvladus @.***>:

I'm working on that right now :) It will be added in 45.1 release.
--
Reply to this email directly or view it on GitHub:
https://github.com/mrvladus/Errands/issues/89#issuecomment-1784198046
You are receiving this because you authored the thread.
Message ID: @.***>

@mrvladus Waiting for this feature! This is the first GTK TODO app with Nextcloud sync and subtask support that I found!

Same here. @mrvladus do you have an ETA when 45.1 will be released?

@madhums probably in couple of days

Added support for multiple lists and calendars in 45.1. It was sooner than a couple of days :)


[core] Add cross-env to docs:size-why

[x] I have followed (at least) the PR section of the contributing guide.

Added cross-env to the docs:size-why command.

Was trying to find the size of the compiled docs website, when yarn docs:size-why failed due to a missing cross-env.
However I was hoping for an output similar to the one from yarn workspace @material-ui/core build, is there a possibility to add that to yarn docs:build as well?

$ DOCS_STATS_ENABLED=true yarn docs:build or $ yarn cross-env DOCS_STATS_ENABLED=true  docs:build if your shell doesn't support the first  syntax.
$ yarn size:why is probably not that usefull. I recommend using yarn size:snapshot and using ./scripts/sizeSnapshot/build/stats.json for analysis. webpack-analyse, webpack-bundle-analyzer or webpack-visualizer are good tools.

$ DOCS_STATS_ENABLED=true yarn docs:build or $ yarn cross-env DOCS_STATS_ENABLED=true docs:build if your shell doesn't support the first syntax.

That's what yarn docs:size-why does, however it keeps failing due to the JS heap running out of memory.
I wanted to check what impact the babel plugin had on a real website, just checking the size of the .next/static folder after running yarn docs:build it's about 56kb smaller.
Using yarn size:snapshot and http://webpack.github.io/analyse it's 2kb


mautrix-slack: init at 0.1.3

A Matrix-Slack puppeting bridge. Been using it for quite some time, decided to upstream.
Setup heavily inspired on mautrix-discord and mautrix-googlechat packages. I plan to submit another PR with related module after this is merged.
replaces: #297221.
Things done

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

What do you think about setting withOlm to true by default? This resolves the problems with insecure build with default settings, and still empowers the user to change the build configuration.
From your comment I understand that mautrick-slack maintainers are OK with people using goolm, even though it's not fully supported configuration yet.

Go implementation of libolm is considered

as an experimental feature

Currently, all of mautrix stack (mautrix-docker, mautrix-slack, mautrix-meta, mautrix-googlechat, mautrix-telegram) uses libolm and have this issue. Migrating users "by default" to an "experimental crypto lib" is not the kind of thing I'd like to do.

I've removed rec and with lib.

Doesn't evaluate...
% nix-build . -A pkgs.mautrix-slack
error:
       … while calling the 'derivationStrict' builtin
         at <nix/derivation-internal.nix>:34:12:
           33|
           34|   strict = derivationStrict drvAttrs;
             |            ^
           35|

       … while evaluating derivation 'mautrix-slack-0.1.3'
         whose name attribute is located at /home/misuzu/nixpkgs/pkgs/stdenv/generic/make-derivation.nix:336:7

       … while evaluating attribute 'buildInputs' of derivation 'mautrix-slack-0.1.3'
         at /home/misuzu/nixpkgs/pkgs/stdenv/generic/make-derivation.nix:383:7:
          382|       depsHostHost                = elemAt (elemAt dependencies 1) 0;
          383|       buildInputs                 = elemAt (elemAt dependencies 1) 1;
             |       ^
          384|       depsTargetTarget            = elemAt (elemAt dependencies 2) 0;

       (stack trace truncated; use '--show-trace' to show the full, detailed trace)

       error: Package ‘olm-3.2.16’ in /home/misuzu/nixpkgs/pkgs/by-name/ol/olm/package.nix:31 is marked as insecure, refusing to evaluate.

Doesn't evaluate...

Please read discussion under this PR, or under any other mautrix-* package.


bump pytest version

Currently in .projenrc.py there is pytest==7.2.1 specified, this results after running 'npx projen' in a requirements-dev.txt with two different pytest lines. pytest==7.2.1 and pytest==7.4.3
The fix is to just bump the version in .projenrc.py tp pytest==7.4.3
Best

Thanks for your comment - Fixed as suggested


Set definable color value or default to first swatch

This component was defaulting to white, which is problematic because white may not be in the color palette.
These changes allow a new defaultColor property which sets the initial state of the component. When this property is not specified, the component will now default to the first color swatch.
An alternate solution would be to make this component fully-controlled, so that it accepts a value and onChange and has no internal state to store the currently selected color.

@Buupu , is there anything I can do to help get this merged?

@Buupu , is there anything I can do to help get this merged?

Sorry for the delay!
Thanks for the contribution.


adding favicon to the career crafters and title name to change

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
when the open career crafters the website doesn't have a logo on the main page and the title of the page is Job Vacancy  title
Use Case
On the main page, the title and logo have to change.
Adding logo in the sidebar
Benefits
No response
Add ScreenShots

please assign me @apu52
please label the gssoc and add level to it
Priority
High
Record

[X] I have read the Contributing Guidelines
[X] I'm a GSSOC'24 contributor
[X] I have starred the repository

@jayanththalla u are assigned.


broken cosmetic images

"image_path": "icons/econ/courier/lockjaw/lockjaw.52c1e8b8b0966c4a792e541e6c3e42ad169f75ce.png",
"image_path": "icons/econ/taunts/taunt_icon_luna_selemene_leap.8ff84aa2e4d9e213d1c0aa42a3e17365ab2b4e7a.png",
"image_path": "icons/econ/testitem_slot_empty.c1bbb374e16703db485ebd1c2a7964c483a194b7.png",

Doesn't work for:
http://cdn.dota2.com/apps/570/icons/econ/items/juggernaut/ward/fortunes_tout/fortunes_tout_npc_dota_juggernaut_healing_ward.37bea0c1aeb8ec88c036fc6dce4244a5107840e3.png

nvm appears to just be a cloudflare caching issue