Suggested specs to train a model

Hey, I was wondering what's the suggested GPU/Memory to train the model using this repo?
When I run it with cog it immediately seems to consumes all available GPU memory and stays like that for about ~10 minutes, however no checkpoints are generated before it transitions to 0% GPU usage or sometimes like shown below, explodes.
I've tried with 16GB and 24GB getting similar results.
docker logs -f 6ea7236352ca
[!] Not using xformers memory efficient attention.
INFO:     Started server process [1]
INFO:     Waiting for application startup.
Thu Dec  8 16:26:01 2022
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.141.03   Driver Version: 470.141.03   CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A10G         Off  | 00000000:00:1E.0 Off |                    0 |
|  0%   23C    P8    58W / 300W |      2MiB / 22731MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
INFO:     Application startup complete.
INFO:     Uvicorn running on http://<IP_ADDRESS>:5000 (Press CTRL+C to quit)
/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/accelerate/accelerator.py:179: UserWarning: `log_with=tensorboard` was passed but no supported trackers are currently installed.
  warnings.warn(f"`log_with={log_with}` was passed but no supported trackers are currently installed.")
/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/utils/deprecation_utils.py:35: FutureWarning: The configuration file of the unet has set the default `sample_size` to smaller than 64 which seems highly unlikely .If you're checkpoint is a fine-tuned version of any of the following:
- CompVis/stable-diffusion-v1-4
- CompVis/stable-diffusion-v1-3
- CompVis/stable-diffusion-v1-2
- CompVis/stable-diffusion-v1-1
- runwayml/stable-diffusion-v1-5
- runwayml/stable-diffusion-inpainting
 you should change 'sample_size' to 64 in the configuration file. Please make sure to update the config accordingly as leaving `sample_size=32` in the config might lead to incorrect results in future versions. If you have downloaded this checkpoint from the Hugging Face Hub, it would be very nice if you could open a Pull request for the `unet/config.json` file
  warnings.warn(warning + message, FutureWarning)
Generating class images: 100%|██████████| 13/13 [04:27<00:00, 20.61s/it]
/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/utils/deprecation_utils.py:35: FutureWarning: It is deprecated to pass a pretrained model name or path to `from_config`.If you were trying to load a scheduler, please use <class 'diffusers.schedulers.scheduling_ddpm.DDPMScheduler'>.from_pretrained(...) instead. Otherwise, please make sure to pass a configuration dictionary instead. This functionality will be removed in v1.0.0.
  warnings.warn(warning + message, FutureWarning)
Caching latents: 100%|██████████| 50/50 [00:04<00:00, 11.42it/s]
Steps:   0%|          | 1/3000 [00:03<2:40:46,  3.22s/it, loss=0.961, lr=1e-6]ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 419, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in __call__
    return await self.app(scope, receive, send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/fastapi/applications.py", line 270, in __call__
    await super().__call__(scope, receive, send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/applications.py", line 124, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/middleware/errors.py", line 184, in __call__
    raise exc
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/middleware/errors.py", line 162, in __call__
    await self.app(scope, receive, _send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
    raise exc
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 21, in __call__
    raise e
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/routing.py", line 706, in __call__
    await route.handle(scope, receive, send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/routing.py", line 276, in handle
    await self.app(scope, receive, send)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/routing.py", line 66, in app
    response = await func(request)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/fastapi/routing.py", line 235, in app
    raw_response = await run_endpoint_function(
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/fastapi/routing.py", line 163, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/starlette/concurrency.py", line 41, in run_in_threadpool
    return await anyio.to_thread.run_sync(func, *args)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/cog/server/http.py", line 77, in predict
    output = predictor.predict(**request.input.dict())
  File "/src/predictor.py", line 289, in predict
    main(args)
  File "/src/dreambooth.py", line 984, in main
    noise_pred = unet(
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/accelerate/utils/operations.py", line 507, in __call__
    return convert_to_fp32(self.model_forward(*args, **kwargs))
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/torch/amp/autocast_mode.py", line 12, in decorate_autocast
    return func(*args, **kwargs)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/models/unet_2d_condition.py", line 367, in forward
    sample = upsample_block(
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/models/unet_2d_blocks.py", line 1255, in forward
    hidden_states = attn(hidden_states, encoder_hidden_states=encoder_hidden_states).sample
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/models/attention.py", line 221, in forward
    hidden_states = block(hidden_states, context=encoder_hidden_states, timestep=timestep)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/models/attention.py", line 479, in forward
    hidden_states = self.attn1(norm_hidden_states) + hidden_states
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/models/attention.py", line 570, in forward
    hidden_states = self._attention(query, key, value)
  File "/root/.pyenv/versions/3.10.9/lib/python3.10/site-packages/diffusers/models/attention.py", line 585, in _attention
    torch.empty(query.shape[0], query.shape[1], key.shape[1], dtype=query.dtype, device=query.device),
RuntimeError: CUDA out of memory. Tried to allocate 512.00 MiB (GPU 0; 22.20 GiB total capacity; 19.76 GiB already allocated; 168.12 MiB free; 20.02 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Update: It worked for me when I enabled gradient_checkpointing and use_8bit_adam flags. Tested on an NVIDIA A10G card

Also as a side note, I was running into this same issue.
I am able to get it working. Running nvidia-smi I saw about 12GB of memory being used by random processes
Doing kill -9 pid freed up more memory and the training seems to be working now


Consider dropping IE10

@ralphtheninja I know I said I want to support IE10 because PouchDB targets IE10, but then there's the browserify/buffer story (https://github.com/airtap/airtap/issues/171).
It's beautiful that we're able to store a Buffer in IndexedDB as-is. But with buffer@4 in IE10, Buffer() instanceof Uint8Array is false. This means we must first convert it to a pure Uint8Array. We would have to do:
Level.prototype._serializeValue = function (value) {
  if (Buffer.isBuffer(value)) {
    if (value instanceof Uint8Array) {
      return value
    } else {
      // IE 10
      var arr = new Uint8Array(value.length)

      for (var i = 0; i < value.length; i++) {
        arr[i] = value[i]
      }

      return arr
    }
  }

  return value == null ? '' : value
}

I don't like that at all. And as I understand it, the Uint8Array implementation is buggy in IE10 (which is why buffer@5 dropped it, in addition to lack of __proto__ support).

Also: I'm not sure PouchDB even uses level-js (anymore) or that they intend to keep IE10.
cc @daleharvey?

// IE 10
var arr = new Uint8Array(value.length)
for (var i = 0; i < value.length; i++) {
  arr[i] = value[i]
}
return arr

Ouch. This is indeed terrible. Lets see if @daleharvery has any input.

Correction. With all the changes I made, I forgot that the original code was:
https://github.com/Level/level.js/blob/e819338e87aa305e57ec9c2fe58168ab5dca6da3/index.js#L67-L73
So this might work:
if (Buffer.isBuffer(value)) {
  if (value instanceof Uint8Array) {
    return value
  } else {
    // IE 10
    return new Uint8Array(value)
  }
}

Still. Most people will probably use level-js with latest browserify, so that use case should be covered IMO. By testing with latest browserify and buffer. Otherwise we're in the blind just to accomodate IE10.
@ralphtheninja Let's be a little bit bold and drop IE10.

@ralphtheninja Let's be a little bit bold and drop IE10.

:+1:

Todo:

[ ] Change the note in the changelog
[ ] Mention this in upgrade guide
[ ] Test with buffer@5 (#99)


DocumentDB Binding, No _id column

Please provide a succinct description of the issue.
I have created a pretty simple POST method that is using an Output DocumentDB to actually store the JSON within. However, I am used to using the MongoDB driver for accessing the DocumentDB service which automatically creates a long string _id column for each document uploaded to a collection. This is not happening when I do the binding, is there any way to make that happen?
My function is written in Node.JS and it is based on a full CRUD Express based REST API that I built and is running against DocumentDB using the MongoDB driver connection.
Thanks,
Brian

Can you give me an example of what your code looks like? After you insert a document, it will have an id automatically created for it in the database

Closing with no answer


Specify which optional dependencies to install

Currently, optional dependencies are installed as a group when in non-interactive mode. There is a request to be able to specify which of the optional ones to install. This would impact the CLI and the Go API.
The CLI would need a flag to take a list of optional dependency names.
The API would need a method to take a list of optional dependencies to install.

Some additional details:

We use names unless an alias is present. When the alias is present use that instead
Linting should make sure the name (alias or name) is unique
The names passed in are the alias or name (in case of no alias)


IndexError: list index out of range

Hi,
I'm getting the following error when trying to run pytextrank with my own data. Is there a way to fix this?
app_1    | Traceback (most recent call last):
app_1    |   File "index.py", line 26, in
app_1    |     for rl in pytextrank.normalize_key_phrases(path_stage1, ranks):
app_1    |   File "/usr/local/lib/python3.6/site-packages/pytextrank/pytextrank.py", line 581, in normalize_key_phrases
app_1    |     for rl in collect_entities(sent, ranks, stopwords, spacy_nlp):
app_1    |   File "/usr/local/lib/python3.6/site-packages/pytextrank/pytextrank.py", line 485, in collect_entities
app_1    |     w_ranks, w_ids = find_entity(sent, ranks, ent.text.split(" "), 0)
app_1    |   File "/usr/local/lib/python3.6/site-packages/pytextrank/pytextrank.py", line 454, in find_entity
app_1    |     return find_entity(sent, ranks, ent, i + 1)
app_1    |   File "/usr/local/lib/python3.6/site-packages/pytextrank/pytextrank.py", line 454, in find_entity
app_1    |     return find_entity(sent, ranks, ent, i + 1)
app_1    |   File "/usr/local/lib/python3.6/site-packages/pytextrank/pytextrank.py", line 454, in find_entity
app_1    |     return find_entity(sent, ranks, ent, i + 1)
app_1    |   [Previous line repeated 137 more times]
app_1    |   File "/usr/local/lib/python3.6/site-packages/pytextrank/pytextrank.py", line 451, in find_entity
app_1    |     w = sent[i + j]
app_1    | IndexError: list index out of range

Got same error

file to replicate the error:
{"id": "17172.docx.json", "text": "\r\nTransitional Aid to Families with Dependent Children (TAFDC)  \r\nConsolidated Report\r\n\t\r\nJanuary, 2017\r\n\r\nReport on Transitional Aid to Families with Dependent Children (TAFDC)\r\nConsolidated Report\r\nJanuary 2017\r\nOverview\r\nIn response to the following legislatives reporting requirements, the Department of Transitional Assistance (DTA) is pleased to provide this comprehensive report on the current status of the TAFDC program including work program requirements, an update on the implementation of Pathways to Self Sufficiency Initiative and the role of the Self Sufficiency Specialist. \r\nLegislative Reporting Requirements \r\nChapter 18 Section 2 of the Massachusetts General Laws requires the Department of Transitional Assistance (DTA) to annually report regarding the Transitional Aid to Families with Dependent Children work requirement.   \r\nChapter 118 Section 3C of the Massachusetts General Laws requires the Department of Transitional Assistance (DTA) to annually report on the Pathways to Self-Sufficiency Program.  \r\nChapter 18 Section 5 of the Massachusetts General Laws requires the Department of Transitional Assistance (DTA) to annually report on the specialists positions established by the commissioner, known as Self-Sufficiency Specialist.  \r\nBackground \r\nDTA\u2019s mission is to assist and empower low-income individuals and families to meet their basic needs, improve their quality of life, and achieve long-term economic self-sufficiency. DTA offers a comprehensive system of programs and supports to help individuals and families achieve greater economic self-sufficiency, including food and nutritional assistance, cash assistance, and employment supports. DTA serves one out of every eight people in the Commonwealth including working families, children, elders, and people with disabilities. \r\nMassachusetts has one of the strongest economies in the country. Despite its educated workforce, high median wage and low unemployment rate, almost 40% of Massachusetts\u2019 children live in low-income families with a parent that works full time. Children of color are especially likely to live in low-income families. \r\nResearch demonstrates a lack of family income, especially during a child\u2019s early years, has immediate and life-long consequences. Children living in poverty are less likely to enter school ready to learn, perform at grade-level, graduate from high school or go to college. As adults they are less likely to participate in the workforce and to achieve economic security for themselves and their children. \r\nOver the past two years, DTA has focused its efforts on implementing the 2014 Welfare Reform Law and placing a renewed emphasis on our employment program to focus on comprehensive and innovative ways to assist our clients moving towards financial independence and economic self-sufficiency. While it is premature to determine if the Pathway to Self-Sufficiency (PSS) program is generating the desired outcomes in only its sixth month of operation, DTA\u2019s front-line staff expresses pride in this shift back to more meaningful client engagement. DTA is focused on reinforcing this program through enhanced avenues of staff input, comprehensive continuous improvement measures, and a review of PSS-related client outcomes. \r\nDTA is also an essential partner in the state\u2019s efforts to implement the Workforce Innovation and Opportunity Act (WIOA), which was signed into law by President Obama on July 22, 2014. WIOA seeks to integrate the states\u2019 workforce systems to better serve employers and jobseekers. WIOA reauthorized the nation\u2019s employment, training, adult education and vocational rehabilitation programs for the first time in 16 years. The new law is substantially different from its predecessor, the Workforce Investment Act (WIA), in its emphasis on targeting low-income adults and youth with limited training and skills to help them overcome barriers to economic success, as well as individuals with disabilities. \r\nSince the passage of WIOA, DTA has been working closely with EOLWD to plan for implementation of a new, closely integrated system of workforce development for DTA clients and others with significant barriers to work. \r\nThe aim of this collaboration is to:\r\ndevelop a meaningful pathway to work and economic self-sufficiency for low-income, disabled and chronically un/underemployed individuals/families; and \r\nensure DTA individuals and families with significant barriers can access the workforce system with the support needed to attain and sustain employment.\r\nWe look forward to reporting on the progress of our Pathways to Self Sufficiency Program and our collaborative work with partners in workforce development to secure better economic futures for DTA clients and their children. \r\nTransitional Aid to Families with Dependent Children (TAFDC)\r\nTAFDC is a state and federally-funded program that provides cash assistance to families with children, and pregnant women, with little or no assets or income. TAFDC is operated under the federal Temporary Assistance for Needy Families (TANF) block grant. Participants receive child care and transportation support associated with job assistance, and can access a number of supportive referrals. As a part of TAFDC, participants may be required to perform a work-related activity as a condition of eligibility. \r\nHowever, many if not all individuals receiving TAFDC, face challenges to employment and long term economic self-sufficiency. These challenges include: need for job training, a high school diploma/equivalency, English as a Second Language services, child care, transportation or mental health services. \r\nTransitional Aid to Families with Dependent Children Caseload \r\nOf the total TAFDC caseload of 31,730 Caseload as of November 2016\r\n, those clients who have a work program requirement total: 6,981. That leaves the remainder of the caseload (24,749 clients) exempt from the work program requirement. Since June 27, 2016, DTA has been tracking and collecting data through our Pathways to Self-Sufficiency (PSS) assessment to better understand the challenges and strengths of our clients. The availability of low-cost transportation as well as safe and affordable child care are the two main challenges facing TAFDC recipients who are pursuing employment opportunities. Beyond these well documented barriers, over 1,500 clients who are work program required report that they are in need of additional education, training or other barrier-removal services to help them gain employment. On average, DTA clients remain on TAFDC for 36 months.\r\nGrant levels have remained unchanged since 2000:\r\nExempt Assistance Units receive monthly:\r\nAssistance\t\tA.\tPayment Standard\t\t\tB.\tPayment Standard\r\nUnit Size \t\t\tNo Rent Allowance\t\t\t\tWith Rent Allowance\r\n     1\t\t\t\t\t$388.00\t\t\t\t\t$428.00\r\n     2\t\t\t\t\t  491.00\t\t\t\t\t  531.00\r\n     3\t\t\t\t\t  593.00\t\t\t\t\t  633.00\r\n     4\t\t\t\t\t  691.00\t\t\t\t\t  731.00\r\n     5\t\t\t\t\t  792.00\t\t\t\t\t  832.00\r\n     6\t\t\t\t              896.00\t\t\t\t              936.00\r\n     7\t\t\t\t              997.00\t\t\t\t           1,037.00\r\n     8\t\t\t\t           1,097.00\t\t\t\t           1,137.00\r\n     9\t\t\t\t           1,197.00\t\t\t\t           1,237.00\r\n     10\t\t\t\t           1,298.00\t\t\t\t           1,338.00\r\nIncremental\t\t\t\t  105.00\t\t\t\t\t  105.00\r\nNonexempt Assistance Units receive monthly:\r\nAssistance\t\tA.\tPayment Standard\t\t\tB.\tPayment Standard\r\nUnit Size \t\t\tNo Rent Allowance\t\t\t\tWith Rent Allowance\r\n     1\t\t\t\t\t$378.00\t\t\t\t\t$418.00\r\n     2\t\t\t\t\t  478.00\t\t\t\t\t  518.00\r\nNonexempt Assistance Units receive monthly(continued):\r\nAssistance\t\tA.\tPayment Standard\t\t\tB.\tPayment Standard\r\nUnit Size \t\t\tNo Rent Allowance\t\t\t\tWith Rent Allowance\r\n    \r\n     3\t\t\t\t\t  578.00\t\t\t\t\t  618.00\r\n     4\t\t\t\t\t  673.00\t\t\t\t\t  713.00\r\n     5\t\t\t\t\t  772.00\t\t\t\t\t  812.00\r\n     6\t\t\t\t              872.00\t\t\t\t              912.00\r\n     7\t\t\t\t              971.00\t\t\t\t           1,011.00\r\n     8\t\t\t\t           1,067.00\t\t\t\t           1,107.00\r\n     9\t\t\t\t           1,165.00\t\t\t\t           1,205.00\r\n     10\t\t\t\t           1,263.00\t\t\t\t           1,303.00\r\nIncremental\t\t\t\t  103.00\t\t\t\t\t  103.00\r\nWork Program Requirement Exemptions\r\nThere are a number of reasons for an individual having an exemption from a work program requirement. \r\nExemption reasons include: \r\ndisabled parents; \r\nparents caring for a disabled child or spouse;\r\nparents whose youngest eligible child is less than two or who have any child who is less than three months; \r\nwomen in their  33rd week of pregnancy and those in their third trimester of pregnancy who have a verified medical condition that prevents them from working; \r\nteen parents who are attending school full time; \r\npersons over age sixty-six; and\r\ncaretaker relatives.\r\nExtensions to Time-Limited Benefits\r\nTAFDC benefits are limited to 24-months within a 60-month period for nonexempt households. Recipients may request an extension of benefits when they are nearing the end of their time limit. Extensions are approved for not more than three months at a time; if additional time is requested, the new extension request will be evaluated based on participation in activities approved in the previous extension.\r\nExtensions are requested for a number of reasons, including:\r\nNot yet found employment;\r\nWages are too low; and\r\nCompleting an education/training program already enrolled in prior to requesting the extension.\r\nIn calendar year 2016, DTA received 1122 extension requests, and approved 213 extensions.\r\nPathways to Self Sufficiency\r\nDTA believes that all clients, both those who are subject to time-limited benefits and those who are not, can be assisted in moving to a better economic position and improved quality of life. To that end, DTA created Pathways to Self-Sufficiency (PSS). The goal of PSS is positive client engagement and targeted supports that lead to employment, career pathways and long term economic self-sufficiency.\r\nAs part of PSS, DTA established an individualized employment development plan for all participating clients to document the progress being made towards the stated goal. The steps towards that goal will be individualized based on the needs of the particular client. PSS has at its core that TAFDC is a transitional benefit and emphasizes the importance of working to secure economic self-sufficiency, the supports available and the benefits of not needing public assistance.\r\nImplementation\r\nDTA developed an assessment tool for case managers to utilize when engaging with clients about their self-identified strengths and challenges in reaching economic self-sufficiency. The Bureau of Program Integrity (BPI) facilitated a meeting with New Hampshire\u2019s TANF Director and Career Center Director to discuss and review their assessment model. DTA incorporated into our Pathways assessment those questions that were not already asked in our application that were germane to helping our clients reach economic self-sufficiency. Prior to the workflow being designed, the assessment was tested in a few local DTA offices. Feedback was incorporated to inform the final design of the workflow.\r\nStaff from DTA\u2019s Central Office hosted a presentation for all cash staff regarding the changes that would be instituted with Pathways implementation on June 27. Following this presentation, senior level staff visited all 22 local offices and met with TAFDC case managers to discuss how Pathways would focus their jobs on assisting clients to reach economic self-sufficiency. These sessions provided an opportunity for case managers to ask questions about the assessment and offer suggestions to fine tune the workflow.\r\nFinally, training sessions were given at DTA\u2019s annual Training Conference held in May as well as webinars developed through DTA\u2019s Training Division. These Webinars (provided in June and available on line for re-viewing) focused on time-management, motivational interviewing techniques, managing difficult conversations and Pathways to Self-Sufficiency BEACON DTA\u2019s data management information and eligibility information system \r\n workflows.\r\nProgress\r\nThe PSS Assessment was launched on June 27, 2016. The cost of implementing the components of PSS was $1,450,456.  It cost DTA on average $3,290 per participant for the 441 available slots. The 441 PSS slots served 6.3% of the 6,981 work program required clients. From those 441 slots, DTA had a 62.5% job placement rate and from that, an 87.2% job retention rate.\r\nThe following components were implemented for Pathways to Self-Sufficiency in light of available resources and appropriations:\r\nCompetitive Integrated Employment Services (CIES) Model II;\r\nCIES Model III;\r\nPre-Benefit Job Search; and \r\nMandatory Orientation. \r\nThe top five reasons clients reported they were unsuccessful in obtaining gainful employment within the 12 months prior to applying for benefits were as follows:\r\n \r\nLack of Skills and training;\r\nLack of work experience; \r\nLimited literacy/math skills;\r\nChild care; and\r\nTransportation.\r\nSelf-Sufficiency Specialists\r\nSelf Sufficiency Specialists (SSS) began their new role at the Department of Transitional Assistance (DTA) in December 2015. In preparation to launch this new role, a detailed job description was developed, training was developed and conducted, and policy documentation about the new role and who it would serve was issued. \r\nBetween April and June 2016, DTA conducted an assessment of how the role was functioning and identified ways to strengthen and clarify the SSS role. While many positive findings resulted from this assessment, there remained issues regarding legislatively mandated caseload caps for these workers. This assessment also concluded limiting the agency\u2019s ability to best utilize resources as policy and circumstance demand would not serve our clients well. \r\nThe rollout of Pathways to Self Sufficiency made it clear that this caseload cap had an adverse impact on DTA\u2019s ability to manage resources and move all clients toward self-sufficiency. DTA recommends that all Case Managers gain the skills and are allowed the time to engage with clients with barriers to employment. Limiting some caseworker\u2019s caseloads results in increases to other caseworker\u2019s caseloads. Ensuring all caseworkers have manageable caseloads is critical, and DTA needs the discretion to make the appropriate decisions regarding what a manageable caseload means. \r\nAs a result, the following recommendations were developed and implemented:\r\nSSS provide intensive case management and support to all teen parents who are heads of household, whether parenting or pregnant.\r\nOther clients who may receive the assistance of an SSS include:\r\nyoung parents (pregnant and/or parenting heads of household under the age of 24); \r\nresidents of emergency assistance shelter, Hotel/Motel, Congregate Shelter, Scattered Site Shelter or Domestic Violence Shelter.\r\nIn limited circumstances, and as determined by a DTA manager, SSSs may also assist other clients who have been identified as having significant challenges in moving towards self-sufficiency. \r\nEach TAO has at least one SSS, with a caseload limited to 60 active clients per specialist. Due to caseload limits, assignment of an SSS will be based on availability. \r\nEffective September 2016, surplus SSSs were reassigned to the cash caseload in order to bring overall caseloads down.\r\nAdditionally, with Pathways now in place, DTA will be able to utilize data to evolve the function of SSS to best serve our clients.\r\nManagers and those serving in the SSS capacity were notified in July of the planned changes with implementation going into effect in early September 2016. In late August, revisions were made to the BEACON Online Guide to reflect the change/clarification in the role, which were published in anticipation of the implementation. \r\nThis shift in focus was in conjunction with establishing specialized EAEDC workers in spring 2016. This established staff dedicated to either an EAEDC caseload or TAFDC caseload where appropriate. The objective of this change was to lower the average caseload for TAFDC caseworkers so they would have more time to focus on moving clients toward self-sufficiency. This was realized, and currently the average TAFDC caseload is approximately 140 clients, a drop from the previous median which approached 200 cases per caseworker. Allowing TAFDC caseworkers more time to engage with clients assists DTA in breaking down barriers and helping clients obtain employment and begin on a path to self-sufficiency. \r\nConclusion\r\nDTA remains committed to its mission of assisting and empowering low-income individuals and families to meet their basic needs, improve their quality of life, and achieve long-term economic self-sufficiency. With Pathways to Self-Sufficiency and Self Sufficiency Specialists, DTA is well positioned to assist all clients in finding a route out of poverty.\r\n2\r\n"}

I have the same issue. Does someone know why this is happening and/or has a temporary fix?

This might be related to issue #9, for me a temp fix is to just always return None, None by adding this directly after 446:
    return None, None

Check the v2.0.0 release for updates that should resolve these issues.


Add populator flow

In 2.4.0 we added the volume populator flow to the migrations as well re-ordering the migration flow.

should we add osp var now?

shouldn't we add osp var now?

it doesn't really matter - these changes should be published after releasing 2.4 along with the addition of osp

LGTM
I have committed Arik's changes, and set DCO to pass.
Thanks @liranr23 for helping the docs team out with this, appreciate it
@ahadas if you need anything further adding, please can I suggest we create a ticket and make any additions after 2.4.0 release?

LGTM
I have committed Arik's changes, and set DCO to pass.
Thanks @liranr23 for helping the docs team out with this, appreciate it
@ahadas if you need anything further adding, please can I suggest we create a ticket and make any additions after 2.4.0 release?

@liranr23 - please do not worry about the suggested edits by @RichardHoch . We will do it. You helped us more than enough. Slainte


Add classic_bags source repo to humble

Please Add This Package to be indexed in the rosdistro.
classic_bags
The source is here:
https://github.com/MetroRobots/classic_bags.git
Checks

[x] All packages have a declared license in the package.xml
[x] This repository has a LICENSE file
[x] This package is expected to build on the submitted rosdistro

New package review performed here: https://github.com/ros/rosdistro/pull/37345#issuecomment-1564539281
In case it streamlines things for you in the future @DLu, we only need one source entry to be added before a package is eligible for a release repository and bloom will cover adding source (and optionally doc) entries when creating the release PR. I'm working on a new bloom that can actually submit these using the same interactive prompts that get used when creating new releases.


Sync Text Scroll Position with Audio

I think it will be great if we can sync the audio with the scroll position of the text

agree. but how can we get the marker position for each verse? or it should scroll based on percentage?

I've been experimenting with some methods, basically we can scroll based on percentage of the audio file duration, not 100% accurate but mostly okay. We also need to adapt with some parts especially some parts where has music intro before the actual verse begin.
But still looking for better solution, maybe we can use audio to text, and sync them based on that data, never tried this method but it seems doable.
I think we need further investigation for this feature.


Python extension fails to activate for missing API proposal entry that is actually not missing

Does this issue occur when all extensions are disabled?: No

VS Code Version: 1.65.0-insider
OS Version: Windows 11
The Python extension is failing to activate in the latest insiders build, and the error says it's because it's trying to use an API proposal that wasn't declared but it actually is. Specifically, it complains about testObserver but it's declared here: https://github.com/microsoft/vscode-python/blob/84a5a04ae416d794ca9a03b7d705ee5f8aecb834/package.json#L21

Steps to Reproduce:

Download the latest version of the Python insiders build (run the "Python: Switch to Insiders Weekly" command, we will migrate to the pre-release mechanism shortly)
Open a Python file to activate the extension (or run the "Python: Select Interpreter" command)
Open the Python channel in the Output panel
See the error below:

[ERROR 2022-1-23 16:1:48.161]: Failure during activation. [Error: Extension 'ms-python.python' CANNOT use API proposal: testObserver.
Its package.json#enabledApiProposals-property declares:  but NOT testObserver.
 The missing proposal MUST be added and you must start in extension development mode or use the following command line switch: --enable-proposed-api ms-python.python
	at _ (c:\Users\luabud\AppData\Local\Programs\Microsoft VS Code Insiders\resources\app\out\vs\workbench\api\node\extensionHostProcess.js:83:64832)
	at Object.get testResults [as testResults] (c:\Users\luabud\AppData\Local\Programs\Microsoft VS Code Insiders\resources\app\out\vs\workbench\api\node\extensionHostProcess.js:99:33817)
	at w.activate (c:\Users\luabud\.vscode-insiders\extensions\ms-python.python-2022.1.1884760391-dev\out\client\extension.js:85:74911)
	at c:\Users\luabud\.vscode-insiders\extensions\ms-python.python-2022.1.1884760391-dev\out\client\extension.js:67:87919
	at Array.map (<anonymous>)
	at f.activateWorkspace (c:\Users\luabud\.vscode-insiders\extensions\ms-python.python-2022.1.1884760391-dev\out\client\extension.js:67:87910)
	at runMicrotasks (<anonymous>)
	at processTicksAndRejections (node:internal/process/task_queues:96:5)]
[ERROR 2022-1-23 16:1:48.162]: sendStartupTelemetry() failed. [Error: Extension 'ms-python.python' CANNOT use API proposal: testObserver.
Its package.json#enabledApiProposals-property declares:  but NOT testObserver.
 The missing proposal MUST be added and you must start in extension development mode or use the following command line switch: --enable-proposed-api ms-python.python
	at _ (c:\Users\luabud\AppData\Local\Programs\Microsoft VS Code Insiders\resources\app\out\vs\workbench\api\node\extensionHostProcess.js:83:64832)
	at Object.get testResults [as testResults] (c:\Users\luabud\AppData\Local\Programs\Microsoft VS Code Insiders\resources\app\out\vs\workbench\api\node\extensionHostProcess.js:99:33817)
	at w.activate (c:\Users\luabud\.vscode-insiders\extensions\ms-python.python-2022.1.1884760391-dev\out\client\extension.js:85:74911)
	at c:\Users\luabud\.vscode-insiders\extensions\ms-python.python-2022.1.1884760391-dev\out\client\extension.js:67:87919
	at Array.map (<anonymous>)
	at f.activateWorkspace (c:\Users\luabud\.vscode-insiders\extensions\ms-python.python-2022.1.1884760391-dev\out\client\extension.js:67:87910)
	at runMicrotasks (<anonymous>)
	at processTicksAndRejections (node:internal/process/task_queues:96:5)]

I'm guessing this is because said API was just finalized? But maybe I'm wrong.

I'm having a similar error on
os: macOS Big Sur 11.6.1
Version: 1.65.0-insider
Commit: 8440b8f47231147823ba9696913d642e5f2d9d58
It is rather severely breaking my experience on python and DBT. I will have to switch back to the non-insider build if this is not resolved soon

Sorry for that. There is a typo in the allow list. It says "python.python" instead of "ms-python.python"


The clerical error in page 11 of 05_lecture.pdf

The shellcode mov eax, edx should be replaced with mov edx, eax


Update website URL in sources/us/tx/brazoria.json

Update the website URL for GIS downloads (e.g., PARCELS.zip) from Brazoria County, Texas.

PARCELS.zip may be a more useful data source for new information as it appears to be kept more up-to-date than PARCELS_W_OWNER.zip


Suggestion: Client rather than server

Would it be possible to reverse the way this works? I.e. make OBS establish a connection to a server rather than the other way around? Communication protocol wouldn't need to be changed but it would make it easier to establish secure connections.
Also if you think about it with Twitch and Bots it would make more sense if your OBS can connect to your 24/7-running bot without IP or port forwarding rules having to be dealt with all the time =)

While that may be a decent idea, it is out of the scope of this project.


Improve performance of DictionaryArray::try_new()

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
https://github.com/apache/arrow-rs/issues/1300 adds DictionaryArray::try_new() for creating DictionaryArrays from existing keys and dictionaries. However, as noted by @jhorstmann in https://github.com/apache/arrow-rs/issues/1300#issuecomment-1037978864 this results in a double validation (that the keys and values are valid arrays, when we know they already are, in addition to validating that all the keys are valid indexes into the dictionary.
Describe the solution you'd like
Minimize the checking in DictionaryArray::try_new() to only verify that all indexes are within the range of the dictionary, which is required for this to be a safe API.
It also might be worth adding a unsafe DictionaryArray::new_unchecked() which builds the arrays from data the user asserts is valid.

I can take it up. Could you assign it me? @alamb

@jackwener I just opened a PR that does a small change to try_new in #1430, shouldn't cause any conflicts I think

@jhorstmann Hello, I am newer for project, I am gradually trying to contribute.
I can't get the point double validation. Could you give me some hint? Thanks !❤

ArrayDataBuilder::build calls ArrayData::try_new, which does a full validation of that struct, including all child ArrayData objects. For example building a DictionaryArray from Int32 keys to String values first validates that the child data containing these strings is valid. Since layout of a StringArray consists of an offset buffer and a data buffer, it has to check that the offsets are monotonically increasing and in bounds for the data buffer. When the child StringArray is valid then also the dictionary keys need to be validated to be in bounds of this StringArray.
In DictionaryArray::try_new, we get the child array as a parameter and can assume that is is valid without having to validate it again. We only need to check that the given keys are in bounds.
I think a possible solution would be to extract the dictionary validation logic out of ArrayData::validate_full into a separate function. DictionaryArray::try_new could then use ArrayDataBuilder::build_unchecked and afterwards call the new function which only validates that the keys are in bounds.


What happens when you reinscribe and inscribe onto the parent satpoint?

there's a movie about this actually called "Predestination" starring Ethan Hawke

https://github.com/ordinals/ord/issues/2607#issue-1966772971
I should've checked this before I made a new issue, but it sends the commit and then get an error

Going to close this in favor of #2607 because it has more information


Apply new containers github repo structure and workflows to Serverless demo app repo

Describe the issue
Compare the new workflows from the containers app last sprint with the existing serverless app and try to port over as much common utility as possible.
Additional context
Add any other context, attachments or screenshots
Definition of done

Re-implement as much as possible from ticket 1744 and clean up the Serverless app deployment workflow if possible.
Add deploy test and prod to serverless
Aim for consistent workflow, given one is terragrunt and one is terraform

not relevant


500 Response using Content-Type header text/xml;charset=utf-16

When sending a POST request with Content-Type header of text/xml;charset=utf-16 to a mapping, an error is returned from wiremock:
com.github.tomakehurst.wiremock.common.xml.XmlException: { "errors" : [ { "code" : 50, "title" : "Content is not allowed in prolog.", "detail" : "Content is not allowed in prolog.; line 1; column 1" } ] }
Mapping
    {
        "id": "05725fdd-e9fb-47c7-a462-cf67de28a0f1",
        "request": {
            "url": "/HttpStatusCodeEcho/200",
            "method": "ANY"
        },
        "response": {
            "status": 200,
            "body": "Wiremock Body 200",
            "headers": {
                "Content-Type": "text/plain"
            }
        },
        "uuid": "05725fdd-e9fb-47c7-a462-cf67de28a0f1",
        "persistent": true
    },

Request Body
<?xml version="1.0" encoding="utf-16"?>
<helloWorld>Hello</helloWorld>

In my testing it did not matter whether the declaration <?xml version="1.0" encoding="utf-16"?> was included or not.
Full Wiremock Response

HTTP ERROR 500 com.github.tomakehurst.wiremock.common.xml.XmlException: { "errors" : [ { "code" : 50, "title" : "Content is not allowed in prolog.", "detail" : "Content is not allowed in prolog.; line 1; column 1" } ] }

URI: | /HttpStatusCodeEcho/200
-- | --
500
com.github.tomakehurst.wiremock.common.xml.XmlException: { "errors" : [ { "code" : 50, "title" : "Content is not allowed in prolog.", "detail" : "Content is not allowed in prolog.; line 1; column 1" } ] }
com.github.tomakehurst.wiremock.servlet.WireMockHandlerDispatchingServlet-26d10f2e
com.github.tomakehurst.wiremock.common.xml.XmlException: { "errors" : [ { "code" : 50, "title" : "Content is not allowed in prolog.", "detail" : "Content is not allowed in prolog.; line 1; column 1" } ] }

Caused by:

com.github.tomakehurst.wiremock.common.xml.XmlException: {
  "errors" : [ {
    "code" : 50,
    "title" : "Content is not allowed in prolog.",
    "detail" : "Content is not allowed in prolog.; line 1; column 1"
  } ]
}
	at com.github.tomakehurst.wiremock.common.xml.XmlException.fromSaxException(XmlException.java:40)
	at com.github.tomakehurst.wiremock.common.xml.Xml.read(Xml.java:125)
	at com.github.tomakehurst.wiremock.matching.EqualToXmlPattern.<init>(EqualToXmlPattern.java:75)
	at com.github.tomakehurst.wiremock.matching.EqualToXmlPattern.<init>(EqualToXmlPattern.java:64)
	at com.github.tomakehurst.wiremock.client.WireMock.equalToXml(WireMock.java:225)
	at com.github.tomakehurst.wiremock.stubbing.StubMappingJsonRecorder.valuePatternForContentType(StubMappingJsonRecorder.java:135)
	at com.github.tomakehurst.wiremock.stubbing.StubMappingJsonRecorder.buildRequestPatternFrom(StubMappingJsonRecorder.java:91)
	at com.github.tomakehurst.wiremock.stubbing.StubMappingJsonRecorder.requestReceived(StubMappingJsonRecorder.java:58)
	at com.github.tomakehurst.wiremock.http.AbstractRequestHandler.handle(AbstractRequestHandler.java:90)
	at com.github.tomakehurst.wiremock.servlet.WireMockHandlerDispatchingServlet.service(WireMockHandlerDispatchingServlet.java:142)
	at wiremock.javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
	at wiremock.org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
	at wiremock.org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
	at wiremock.org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
	at wiremock.org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at wiremock.org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
	at wiremock.org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at wiremock.org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
	at wiremock.org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at wiremock.org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
	at wiremock.org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at wiremock.org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763)
	at wiremock.org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
	at wiremock.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at wiremock.org.eclipse.jetty.server.Server.handle(Server.java:516)
	at wiremock.org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:400)
	at wiremock.org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
	at wiremock.org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:392)
	at wiremock.org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
	at wiremock.org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
	at wiremock.org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
	at wiremock.org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
	at wiremock.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
	at wiremock.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
	at wiremock.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
	at wiremock.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
	at wiremock.org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
	at wiremock.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
	at wiremock.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
	at java.base/java.lang.Thread.run(Unknown Source)

Wiremock Docker Output
2022-07-18 15:18:03.127 Request received:
nnn.nn.nn.nnn - POST /HttpStatusCodeEcho/200

Accept: [*/*]
User-Agent: [PostmanRuntime/7.29.0]
Connection: [keep-alive]
Postman-Token: removed
Host: removed
Accept-Encoding: [gzip, deflate, br]
Content-Length: [71]
Content-Type: [text/xml;charset=utf-16]
㰿硭氠癥牳楯渽∱⸰∠敮捯摩湧㴢畴昭ㄶ∿㸍਼桥汬潗潲汤㹈敬汯㰯桥汬潗潲汤�

Matched response definition:
{
  "status" : 200,
  "body" : "Wiremock Body 200",
  "headers" : {
    "Content-Type" : "text/plain"
  }
}

Response:
HTTP/1.1 200
Content-Type: [text/plain]
Matched-Stub-Id: [05725fdd-e9fb-47c7-a462-cf67de28a0f1]

Wiremock Info
v2.32.0 (official docker image)

The exception you're seeing is due to another stub (not the one you've pasted here) that uses the equalToXml matcher and has a malformed expected value. If you fix this, then the request you're making should start to work.

The exception you're seeing is due to another stub (not the one you've pasted here) that uses the equalToXml matcher and has a malformed expected value. If you fix this, then the request you're making should start to work.

Thanks for having a look. Doesn't the Matched-Stub-Id: [05725fdd-e9fb-47c7-a462-cf67de28a0f1] of the docker output indicate it matched my request to what I expect?
I took a look at my other mappings and none use equalToXml as a matcher.

I haven't been able to get it working from postman still, but my application code uses little endian byte order so I tried sending a content type header of text/xml;charset=utf-16le and it actually worked this way from the application code. It makes no difference from postman though. There might be byte order marks involved from the application code but I haven't been able to find them or rule that out. I tried testing with and without BOMs but nothing made a difference. I'm not confident I was actually getting the application code to output BOMs during my testing.

From this line: at com.github.tomakehurst.wiremock.stubbing.StubMappingJsonRecorder.valuePatternForContentType(StubMappingJsonRecorder.java:135) it seems you've got the legacy recorder running when you see this issue. This isn't supported any more and is still present only for backwards compatibility.
If recording is what you're attempting, I suggest trying to new recorder instead.

From this line: at com.github.tomakehurst.wiremock.stubbing.StubMappingJsonRecorder.valuePatternForContentType(StubMappingJsonRecorder.java:135) it seems you've got the legacy recorder running when you see this issue. This isn't supported any more and is still present only for backwards compatibility.
If recording is what you're attempting, I suggest trying to new recorder instead.

Ahh yes you're correct. It looks like the legacy recorder is in use. I can try switching it over to see if that helps.

Closing, since there seems to be a way forward.


updating error messaging

BACKEND PULL REQUEST
Related Issue

#4656

Changes Proposed

more description / screenshots in the issue but basically: catch the specific errors mentioned in the issue and improve error messaging

Additional Information

decisions that were made
notice of future work that needs to be done

Testing

example file is in the issue

not blocking but this could be an opportunity to revisit the copy of the errors table.
@lauraykerr should these use sentence case?
https://github.com/CDCgov/prime-simplereport/blob/d1fc13996d841f6fb221eb90b0da9b9e880fed05/frontend/src/app/testResults/uploads/Uploads.tsx#L289-L290

@mehansen Not blocking but yes please!! If possible, would love the following edits:

Requested Edit = Error description
Areas Containing the Requested Edit = Location of error

https://github.com/CDCgov/prime-simplereport/blob/d1fc13996d841f6fb221eb90b0da9b9e880fed05/frontend/src/app/testResults/uploads/Uploads.tsx#L289-L290


All maps: include option to select region: Vlaanderen, Wallonie, Brussels hoofdstedelijk gewest. By default all 3 selected. First INBO needs to add extra column indicating in which region the observation/reporting is

@damianooldoni can you provide @mvarewyck with a list of 10x10km gridcells by region (flanders, brussels, wallonia) ?

@damianooldoni I will also need it for the 1x1 km gridcells

I will, sure. I have some specs related questions:

My idea is to add three columns isFlanders, isWallonia, isBrussels to the existing grid files with TRUE/FALSE values. Do you agree on this? If yes, can you point to the files I need to work on? Are you maybe using the ones from TrIAS indicators: https://github.com/trias-project/indicators/tree/main/data/external/utm1_bel and https://github.com/trias-project/indicators/tree/main/data/external/utm10_bel ? If so, I will place the modified files to another directory as by definition any modified file cannot remain in ./external
Is the code I write to add these columns of any interest and so must be public somewhere? If yes, let me know where you prefer I put it. Otherwise, I think I will put it somewhere in trias indicators repo (but at the moment without publishing on correspondent GitHub Pages website)
I will assign grid cells containing the regional borders to multiple regions (TRUE values). Is it ok to you?

First & foremost I was "falsely" under the impression you did a similar exercise already.

I will, sure. I have some specs related questions:

My idea is to add three columns isFlanders, isWallonia, isBrussels to the existing grid files with TRUE/FALSE values. Do you agree on this? If yes, can you point to the files I need to work on? Are you maybe using the ones from TrIAS indicators: https://github.com/trias-project/indicators/tree/main/data/external/utm1_bel and https://github.com/trias-project/indicators/tree/main/data/external/utm10_bel ? If so, I will place the modified files to another directory as by definition any modified file cannot remain in ./external

I my opinion adding those 3 column should be sufficient. We use the same files but downloaded directly from eea (therefor they are not UTM but EEA reference grids).  @mvarewyck what do you think ?

Is the code I write to add these columns of any interest and so must be public somewhere? If yes, let me know where you prefer I put it. Otherwise, I think I will put it somewhere in trias indicators repo (but at the moment without publishing on correspondent GitHub Pages website)

These grids could be of interest to many Belgium regional issues therefor I think it would be good to place them somewhere publicly accessible. Currently the grids are placed here in this public repository but we intend to move them, along with all the other data, to a S3 bucket for more streamlined updating. A more sustainable publicly accessible location is thus advised.

I will assign grid cells containing the regional borders to multiple regions (TRUE values). Is it ok to you?

@mvarewyck what do you think ?

@SanderDevisscher: me too, but what I did was just restricted to protecte areas so it was quite hard coded. Any how, it's something I can do of course. Or maybe @jrhillae did it already in the context of LIFE RIPARIAS dashboard?
Publishing them to zenodo could be also interesting. Could also be nice to use geojson format as it is way more open than GIS shapefiles and also you have one (1!) file instead of oh so many 😄 SOme more info about geoJSON and how easy it is to use such format, you can find on the INBO tutorial: https://inbo.github.io/tutorials/tutorials/spatial_standards_vector/

My idea is to add three columns isFlanders, isWallonia, isBrussels to the existing grid files with TRUE/FALSE values. Do you agree on this? If yes, can you point to the files I need to work on? Are you maybe using the ones from TrIAS indicators: https://github.com/trias-project/indicators/tree/main/data/external/utm1_bel and https://github.com/trias-project/indicators/tree/main/data/external/utm10_bel ? If so, I will place the modified files to another directory as by definition any modified file cannot remain in ./external

I my opinion adding those 3 column should be sufficient. We use the same files but downloaded directly from eea (therefor they are not UTM but EEA reference grids). @mvarewyck what do you think ?

These 3 columns are sufficient. As @SanderDevisscher mentioned, we extract the shape files from EEA

I will assign grid cells containing the regional borders to multiple regions (TRUE values). Is it ok to you?

@mvarewyck what do you think ?

Yes, this is fine. The user will select one or more regions (isFlanders, isWallonia, isBrussels) in the app. Based on this selection we will determine the unique grids that should be shown in the plot.

Could also be nice to use geojson format as it is way more open than GIS shapefiles and also you have one (1!) file instead of oh so many

Conversion to geojson format is perfectly fine. We also use it for other projects to have this file reduction.

I think I solved this issue Please, @SanderDevisscher and @mvarewyck: could you please check whether you can:

open the three Geopackages in data/output mentioned in https://github.com/trias-project/indicators/pull/119 and check whether they fulfill your expectations
successfully reproduce the workflow (Rmd) mentioned in https://github.com/trias-project/indicators/pull/119

@SanderDevisscher is the official reviewer just because he is member of the trias-project GitHub organisation.

@damianooldoni Thanks, this works perfectly at our side.
@SanderDevisscher Two more questions on this:

Do we need to restrict only the map to the selected regions or also the other plots? E.g. barplot (with time selector) on Species information > Observations page
Do we also need to include this filter option for region (Flanders, Wallonia, Brussels) on the management page for e.g. Lithobates catesbeianus? The current page shows a map with occurrences for all regions together with cpue in Flanders only.

@damianooldoni Thanks, this works perfectly at our side.
@SanderDevisscher Two more questions on this:

Do we need to restrict only the map to the selected regions or also the other plots? E.g. barplot (with time selector) on Species information > Observations page

I think its best to see it as a filter for the "global" indicators and as a category for the bar plot on species information ea different colors for the different regions. @timadriaens @bramdhondt what do you think ?

Do we also need to include this filter option for region (Flanders, Wallonia, Brussels) on the management page for e.g. Lithobates catesbeianus? The current page shows a map with occurrences for all regions together with cpue in Flanders only.

I think this merits a discussion. In the current version of bullfrog and ruddy duck management only part of the flemish management is included. I think allowing users to filter based on regions will highlight the lack of info about management in Wallonia or maybe this is already the case as is.  I hope data about bullfrog management in Wallonia will become freely available in the future. @timadriaens @bramdhondt what do you guys think about implementing a region filter on management ?

@SanderDevisscher - "what do you guys think about implementing a region filter on management ?" Since it is likely that a lot of information is gathered at regional level only, I think implementing a region filter makes sense, as the highlighted data is then closer to reality.

I will include a filter then for the regions at the top of the management page.
Trend plot will have a single line per selected region (instead of just flanders).
For Lithobates, the filter will be repeated for the barplot at the bottom
@SanderDevisscher Could you add to the shape files communes.geojson and provinces.geojson here

a single region column  (flanders, wallonia, brussels)
add communes and provinces for the other regions (wallonia & brussels)

As discussed during meeting.
TODO for management page: include black border for 'gewest' if 'provinces' is selected.


Dear, this work is nice! Wait for Open source code provided for other workers to learning!

Thanks for your interest in our work. Code is available now!


docs: Add option to skip theme warnings

Option required to update Java and CPP drivers to 1.4.x.
Note that it is not possible to rename some files on these repos since the docs are being synched from an upstream repo.
How to test
The new option is tested in https://github.com/scylladb/sphinx-scylladb-theme/actions/runs/4577000903/jobs/8081874608?pr=741

I think we can merge it, as there is no other way to test it.
The option name and the allowed value are self-explanatory.


Next

Merge next version updates with master

Codecov Report

Merging #6 into master will increase coverage by 0.13%.
The diff coverage is 66.66%.

@@             Coverage Diff              @@
##             master       #6      +/-   ##
============================================
+ Coverage     52.82%   52.96%   +0.13%
- Complexity      725      728       +3
============================================
  Files             5        5
  Lines          1397     1399       +2
============================================
+ Hits            738      741       +3
+ Misses          659      658       -1

Impacted Files
Coverage Δ
Complexity Δ

src/MySQLLink.php
0% <0%> (ø)
54 <0> (+1)
:arrow_up:

src/MySQLTable.php
72% <100%> (+0.12%)
132 <0> (ø)
:arrow_down:

src/Column.php
92.59% <100%> (+0.44%)
163 <0> (+2)
:arrow_up:

src/MySQLQuery.php
37.61% <50%> (ø)
326 <0> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c2e8690...4cdf04f. Read the comment docs.


Config templates : optional use of sub modules and the option to recursively generate templates

The current version creates templates per module, but sometimes it’s only necessary to generate some files of the module (for example a subcomponent from IDS to update rulesets may not need to regenerate the full configuration). Optional splitting things into parts may solve this.
When we implement this, we also need the option to generate all templates from the module including sub modules and perhaps also all templates used by the system (to use when the system starts)

@AdSchellevis the sample data is still there, should it be removed?

@fichtner I would rather keep a sample because it uses more features then the helloworld sample, but I will move it out of the way so it won't generate automatically.

@AdSchellevis as long as the error is fixed it can also stay there. no clue what condition triggers this, have been unable to reproduce and the backtrace was never complete

@fichtner A wrong assumption from my end :) I removed the offending code.


Support using babel 7 for .ts, .tsx, and new .babel.ts.

Approach
Use babel only as a fallback for .ts, .tsx since:

babel must be configured with the new in babel 7 typescript
transform,
the babel typescript transform does not perform type-checking, and
it is plausible that both ts-node is expected to be used for .ts
and @babel/register to be used for .babel.js.

The new .babel.ts should only be needed as an escape hatch if
ts-node is present, but babel is preferred for interpret; for
example:

"deploy": "ts-node scripts/deploy.ts" in package.json scripts and
webpackfile.babel.ts, where babel is preferred.

Possible issues
I believe this won't add any breaking changes that are not both very rare and easily fixable, but adding an entry for "escape-hatch" purposes is new, it looks like.
For that, I'm wondering if this should also add .babel.tsx, for completion and to avoid possible confusion in rare cases, given that .babel.js exists and .babel.jsx doesn't simply because .jsx already obviously needs transform.
Another issue is that since extensions only includes .ts for .ts and .tsx for .tsx this means that a .ts file compiled with babel 7 can't import a .tsx file (and vice-versa), unlike with ts-node. On the other hand, I was simply following the pattern of .babel.js and .jsx, and apparently this hasn't been an issue so far.
Drive-by fixes
#47 duplicated the comment on extensions, which was previously only on the first case. Just moved it up.
jsVariantExtensions included .babel.js, .jsx and .ts, but not .tsx, so I added that when I added .babel.ts.
Testing
I already had a repository set up with a webpackfile.ts wrapped with a webpackfile.js:
require('@babel/register');
module.exports = require('./webpackfile.ts');

I updated this project to use this fork by adding "resolutions": { "interpret": "link:../js-interpret" } to the package.json and deleted the webpackfile.js, and webpack still worked, and a console.log in .babelrc.js gets echoed.
Adding a type error to webpackfile.ts (const x: string = 0) does not cause a failure when running webpack (since babel doesn't do type checking).
I then added ts-node to the dependencies and the type error was then reported as expected.
I then renamed the config file to webpackfile.babel.ts and babel was used again.

❤  Love the detail on this PR. I'm pretty swamped until sometime next week but I'll review when I can.

@phated Here is your scheduled end-of-month ping ⏰

Sorry to keep poking, @phated - have you had a chance to look at this yet? I'm perfectly happy to pull anything you would want to take more care with into a separate PR, if it would help.

Rebased and merged as 17546bb6933cf7c13cf8fb659f969bb257b8b72f
Thanks for the work on this @simonbuchan!
This will be published along with the ESM stuff once I get that sorted.

Hey thanks! Great to see this survived!


Edit product variants

@restmount, on Gollos we has simple design

Click on cell and type new value.

Thanks @sonufrienko !
I like your grid.


Rendering issues with Sodium(Forge version).

Sodium version: https://github.com/AeiouEnigma/sodium-forge/releases/tag/v0.1.1-build1

This is probably due to the fact that Sodium changes the render. I don't know if it will be possible to fix this on your part or on the part of the author of the port.

Hi there! Thanks for reporting this, which mod version are you using?

Also, would you mind checking if the latest version of sodium forge fixes this issue? I've just tested this and it appears to work


Cannot navigate to a controller action with the name "Async"

Describe the bug
Hitting a route, whose action is called "Async" does not work with ASP.NET Core 3.0.
The problem is reproducible with the template MVC project that can be created from VS 2019, but a sample is added for reference at:
https://github.com/Stamo-Gochev/aspnet-3.0-async-route
The Async action is added in https://github.com/Stamo-Gochev/aspnet-3.0-async-route/blob/master/asp-net3/Controllers/HomeController.cs#L18
To Reproduce
Steps to reproduce the behavior:

Run the project
Navigate to the URL https://localhost:44383/Home/Async

Expected behavior
The view is displayed.
Current behavior
This localhost page can’t be found
I suppose this might be hitting some limitation/reserved word, so is renaming the only option?

See https://github.com/aspnet/AspNetCore/issues/4849
cc @Eilon @pranavkm (We didn't make an announcement for this)

We didn't make an announcement for this

https://github.com/aspnet/AspNetCore/issues/4849#issuecomment-462976517 😄 I can do a thing.

@Stamo-Gochev there's a flag to turn off this behavior if you'd like: MvcOptions.SuppressAsyncSuffixInActionNames.


Update wrapper to latest nightly

With the configuration cache load-after-store behavior enabled by default.

@bot-gradle test and merge

OK, I've already triggered a build for you.


dd: incorrect seek on oseek=1Bx2x4

Coreutils dd v9.4.113-c01ee:
$ echo abcdefghijklm | ../gnu/src/dd oseek=1Bx2x4 bs=5 > out 2> /dev/null && cat out
^@^@^@^@^@^@^@^@abcdefghijklm

(The ^@ are null bytes.)
On uutils dd:
$ echo abcdefghijklm | ./target/debug/dd oseek=1Bx2x4 bs=5 > out 2> /dev/null && cat out
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@abcdefghijklm

This is from the GNU test suite file tests/dd/bytes.sh.

seems like coreutil's dd treats the oseek operand  as bytes if it contains a 'B' anywhere in the argument, even though it's says in the man page that  it will only do so if the argument ends in a 'B'  but in our implementation we only check for the 'B' at the end of the string. In this case 1Bx2x4  'B' appears not at the end of the string so it treats it as blocks and failing the test case


Add support for inline values

From @rajivharris on April 20, 2018 2:12
VSCode Debugger Protocol now supports inline values for variables when debugging. It would be great if vsdbg/vsdbg-ui adds support for this.
Debugger Protocol:
https://github.com/Microsoft/vscode-debugadapter-node/issues/78
https://github.com/Microsoft/vscode-debugadapter-node/blob/896566e0be3f48e5cf90fb715b3b3ffbfa777888/protocol/src/debugProtocol.ts#L1329-L1337
VSCode Support:
https://github.com/Microsoft/vscode/pull/16129
Copied from original issue: dotnet/coreclr#17693

From @RussKeldorph on April 20, 2018 16:29
@dotnet/dotnet-diag @tommcdon

From @noahfalk on April 21, 2018 0:37
@gregg-miskelly - I think this is for you guys more than it is for us? Let us know if there is a corresponding runtime part of the ask.

Here is documentation on the VS Code feature: https://code.visualstudio.com/updates/v1_9#_inline-variable-values-in-source-code
And some notes about how VS Code implemented it: https://github.com/Microsoft/vscode/issues/12256
I don't know how general purpose the VS Code implementation will prove to be. But we can give it a try...

Any news on inline variables for VSCode with OmniSharp?


Merge branch 'stable' into merge_stable

The merged change should be removed right away.

The merged change should be removed right away.

huh? I'd pull this thinking it was simply a maintenance pull, but I'm puzzled by the comment.

We deprecated something in the point release that was accidentally released in 2.067.0, and we should remove that alias in 2.068.0.

ping


Updates the README.md with a new layout

Updates the README.md with a more intuitive layout.
It also:

Moves around a few things
Uses the  feature of GitHub to make installation pages
dropdown
Floats the logo to the right
Changes the gif to asciinema

:white_check_mark: odo build 1467 completed and artifacts can be found here (for commit https://github.com/redhat-developer/odo/commit/e798bb20fd by @cdrage)

It's best to view the changes from here: https://github.com/redhat-developer/odo/blob/5aa43435d8947cebae8e808bf1479390f659fa3f/README.md :100:

@sspeiche thanks! 1 more ack? @kadel ?

:white_check_mark: odo build 1802 completed and artifacts can be found here (for commit https://github.com/redhat-developer/odo/commit/89aaf37709 by @cdrage)

Tests are failing due to flakiness (this PR doesn't touch any code...)

Just one thing. Way back we agreed that we will format odo as odo (lower case) unless it is at the beginning of the sentence.

I was thinking that could be a different PR, since this is a just about
rearranging items.
I'd like to update some of the phrasing as well, I can take that as a
follow up, For example, instead of saying OpenShift Do...say what it
actually is "developer focused CLI for OpenShift".
On Thu, Feb 28, 2019 at 12:58 AM Tomas Kral<EMAIL_ADDRESS>wrote:

Just one thing. Way back we agreed that we will format odo as odo (lower
case) unless it is at the beginning of the sentence.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/redhat-developer/odo/pull/1299#issuecomment-468191461,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAsYnK5Qsmc6uKaAyZsgdsFKQa7Bkza2ks5vR5oxgaJpZM4amDD9
.

@sspeiche Okay. Issue opened here: https://github.com/redhat-developer/odo/issues/1397


How to get tare?

This code work perfect, calibrating i so easy.
After I calibrated the calFactor using examples/Calibration.ino, its save to eeproom.
And i just run another examples and get calFactor from eeprom.
It's work perfectly.
But, when I restart the serial monitor with mass at the load cell, the value is reset to 0. And value become negative when taking out mass from the loadcell.
How to start the code if we have mass at the loadcell without reset the value?
Thank you
sorry, i m not using english

Hi, thanks!
If you need to restart the micro controller without loosing the old value I suggest that you save the tareoffset to eeprom and then restore it after restart:
//before restart:
long tare_offset = LoadCell.getTareOffset(); //save this value to eeprom

//after restart, restore the previous value from eeprom and set:
LoadCell.setTareOffset(tare_offset);

Hi Thank you,
I will try it tomorrow.
Thank you for your fast respond.

Hi, another questions is, how to start without LoadCell.start() and directly calculating object mass when serial monitor is opened?

Hi, another questions is, how to start without LoadCell.start() and directly calculating object mass when serial monitor is opened?

Try to put the code below in the setup() part of your sketch so that it runs before the loop is startet. That should fill up the data set. I will make a library function for this in the next release.
///assuming that the dout pin is connected to D4:
  int s = LoadCell.getSamplesInUse() + 2; // get number of samples in data set
  while ( s > 0 ) {
    LoadCell.update();
    yield();
    if (digitalRead(4) == LOW) { // HX711 dout pin is pulled low when a new conversion is ready
      LoadCell.getData(); // add data to the set and start next conversion
      s--;
    }
  }

In latest release 1.2.0 there  are new start() functions with selectable tare/no tare. There are also new functions for refreshing the dataset before readiing in loop, after i.e. restart/reset


Update Vagrant starter guide.

Updated the guide to state that default Vagrant VM is configured with 1GB memory.

LGTM


Pagination Component

Closes #32
Pagination component with footer layout modifier.

Deploy preview for pf-next ready!
Built with commit 90942652cb2a03813ce008d6e03eae07f3df332e
https://deploy-preview-941--pf-next.netlify.com

@kybaker @mcarrano would you review this one as well?

@mattnolting - can we narrow the input? We only really need space for 3 maybe 4 numbers.

I'm questioning why we need different variations of the pagination component for the footer and anywhere else. From a design perspective I'd like to see a consistent presentation of pagination throughout. Should the footer really be a component or is that just a demo that pulls together a pagination control plus a select list? Will try to pull together a discussion on this.

Sorry if I'm jumping into this conversation (and code) late. We're currently working on a pagination component for RH Elements and have given a lot of consideration to how the pagination would function without JavaScript.
Using a <button> element requires JavaScript, but we should be doing our best to follow Progressive Enhancement) methodology. Using an anchor link (<a href="#">) with a correctly linked HREF, would provide users with a functioning pagination component should JavaScript not load.
This will ensure accessibility as well as generally improve usability across browsers. Semantically, as well, pagination is a form of navigation (thus using links is more appropriate).

Thanks for reviewing, @markcaron!
I definitely don’t oppose following the progressive enhancement methodology. But in the context of patternfly, I struggled with how this would be incorporated and consumed. I'm not even sure this is possible with our react components, but please let me know if that's not the case.
At this phase in development, the html is being built with the idea that javascript will be there. But for future phases, we do want to continue enhancing the overall accessibility and usability of patternfly. I would love for this to be something that’s on the table for future enhancements.

Regarding the <button> vs <a>, I definitely agree that the consumer should be able to implement these as <a> elements, for cases where there are specific urls for specific pages of contents. But I can imagine cases where there wouldn't be a url for a specific page, and in that case, the <button> would be better.
My suggestion would be to implement the css so that either <button> or <a> could be used.


Add and document testing capabilities for all statistical methods.

tests have been integrated into the documentation using the make doctest command - until a dedicated testing suite for all methods is created (way in the future), I'll mark this as complete


fix file naming

we have a component named: sl-grid-column-header.js
and a template: sl-grid-header-column.js

@notmessenger taking this.


Rel note builder

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: VictorLowther:x: mclambYou have signed the CLA already but the status is still pending? Let us recheck it.


Power menu shows up only in classic power menu app

Power menu shows up only whent the classic power menu Is open in the launcher or any other app when I hold the power button it just vibrates it worked perfectly fine but now it doesn't work normally and the default power menu doesn't show up to when classic power menu gets root privileges from magisk
I'm using lsposed zygisk

What device?

Poco x3 pro

Almost definitely caused by MIUI's restrictions. Nothing I can do.

It worked before I don't update anything and I'm with root lsposed

MIUI 13

Fixed draw over other apps in background wasn't enabled


Ignore the ignored error in SyncAndGetUserSpecificDiff properly

This error was already supposed to be ignored but alas, it wasn't properly ignored:
https://discord.com/channels/322538954119184384/322538954119184384/1153705341620600833
Oversight of #21487.

Line 1347 should be return diff, nil

True, that makes even more sense.

Thank you for taking the bug report on chat. Unfortunately it isn't trivial for me to check if this fixes the problem

@GiteaBot ping?

Thank you for taking the bug report on chat. Unfortunately it isn't trivial for me to check if this fixes the problem

You can use the 1.20 nightly build, it is trivial.


Target Steve API as resource base for Rancher Desktop builds

supports rancher-sandbox/rancher-desktop#1192

@rak-phillip This can be merged but needs an empty commit bump to get the Drone PR check to run again (there was a problem at the time)


Update README.md and RELEASE.md

Signed-off-by: zhu733756<EMAIL_ADDRESS>
update RELEASE.md and README.md

Hi @Bettygogo2021,
Could you please help to review this PR? Thanks.


Add FTSchizO SGB+FLR

Thanks in advance.

Closed due to later/duplicate PR: https://github.com/TowoLabs/ftso-signal-providers/pull/230


Constraints: "periodic smoothing [soon...]"

How soon? :) I ask because this constraint would be quite useful for time series forecasting applications.

Apologies, I was on an extended trip, I'll comment back soon :).

@conduit242 awesome. i just got back from a trip as well!
im excited to collaborate on this!

@dswah and @conduit242 , I came across this issue when trying to reproduce this cool bird migration paper in Python.   My first attempt at computing the centroids of each bird species for each day of the year was a bit noisy.
Here's how the authors cleaned up the mess:

The mean of each coordinate was allowed to vary smoothly as a function of day of the year using a cyclic penalized B-spline, so the model smoothly joined daily location estimates made for 31 December and 1 January.

So just another vote that this would be great!
I'm thinking I could probably fake this by simply copying part of the dataset onto each end and using non-cyclic p splines.    Think that would work?

@dsway, I'm excited to see this progress and to try this.   Will report back soon I hope!


NavAreaBackground in HamburgerMenu doesn't do anything

According to the T10 Wiki:

NavAreaBackground (SolidColorBrush)

This property controls the background color of the panel.

Changing this property by adding to the style in Custom.xaml (For the minimal project) does nothing.
 <Style TargetType="controls:HamburgerMenu">
                <Setter Property="AccentColor" Value="{StaticResource CustomColor}" />
                <Setter Property="HamburgerBackground" Value="Green" />
                <Setter Property="NavAreaBackground" Value="Red"></Setter>
                <Setter Property="VisualStateNarrowMinWidth" Value="{StaticResource NarrowMinWidth}" />
                <Setter Property="VisualStateNormalMinWidth" Value="{StaticResource NormalMinWidth}" />
                <Setter Property="VisualStateWideMinWidth" Value="{StaticResource WideMinWidth}" />
 </Style>

I can see the issue is relating to this piece of code from HamburgerMenu.xaml.cs:
  switch (RequestedTheme)
                {
                    case ElementTheme.Light:
                        ...
                        NavAreaBackground = Colors.DimGray.ToSolidColorBrush();
                        ...
                        break;
                    case ElementTheme.Default:
                    case ElementTheme.Dark:
                        ...
                        NavAreaBackground = Colors.Gainsboro.Darken(ColorUtils.Accents.Plus80).ToSolidColorBrush();
                        ...
                        break;
                }

It seems that the coloring is hardcoded. I can submit a pull request if needed.

First I tested changing the tag in Shell.xaml.
<Controls:HamburgerMenu NavAreaBackground="Lime">

And that worked. Then I tested changing Custom.xaml.
<Style TargetType="controls:HamburgerMenu">
    <Setter Property="NavAreaBackground" Value="LemonChiffon" />
    <Setter Property="AccentColor" Value="{StaticResource CustomColor}" />
    <Setter Property="HamburgerBackground" Value="Green" />
    <Setter Property="VisualStateNarrowMinWidth" Value="{StaticResource NarrowMinWidth}" />
    <Setter Property="VisualStateNormalMinWidth" Value="{StaticResource NormalMinWidth}" />
    <Setter Property="VisualStateWideMinWidth" Value="{StaticResource WideMinWidth}" />
</Style>

And that didn't work. :( Dang. I will look into this.

Does anyone @Windows-XAML/community see what's wrong? I'm drawing a blank.

Running the Minimal sample, I see that RefreshStyles in HamburgerMenu.xaml.cs is being called on application launch. In that method, we are overriding the NavAreaBackground along with every other user set color:
NavAreaBackground = Colors.DimGray.ToSolidColorBrush(); //For light theme

and
NavAreaBackground = Colors.Gainsboro.Darken(ColorUtils.Accents.Plus80).ToSolidColorBrush(); //For dark theme

Removing these two lines fixes the issue, but introduces a new issue where the color doesn't update when the theme setting is updated, which can be fixed by referencing the style as a ThemeResource:
https://github.com/Windows-XAML/Template10/issues/355#issuecomment-158562654

Ah. Yeah, I see the issue now.

I cannot figure this one out.

If you want to set the NavAreaBackground, you cannot use AccentColor.


Internal Server Error: esbuild_1.startService is not a function

While trying to reproduce #37 I stumbled upon this one. Here is the reproduction for it https://github.com/khalibloo/vite-pages-esbuild-bug
In both issues, I used the same commands on 2 different machines at the same time, and got different project scaffolding. Comparing the package.json alone shows they're very different. The machine on #37 is on node v14.17.4 and npm v6.14.14, while the one for this issue is on node v14.17.1 and npm v6.14.13. No significant version differences.
Steps (use pnpm or npm, both give the same error)

Create a new vite-pages project pnpm init vite-pages app-demo --template app
Install dependencies pnpm i
Start dev server pnpm dev

Error message
> pnpm dev

><EMAIL_ADDRESS>dev D:\Workspace\Web\Playground\vite-pages-demo
> vite serve

(!) "alias" option is deprecated. Use "resolve.alias" instead.
Pre-bundling dependencies:
  react
  react-dom
  react-router-dom
(this will be run only when your dependencies or config have changed)

  vite v2.5.6 dev server running at:

  > Local: http://localhost:3000/
  > Network: use `--host` to expose

  ready in 1044ms.

23:47:29 [vite] new dependencies found: vite-pages-theme-basic, updating...
23:47:29 [vite] ✨ dependencies updated, reloading page...
23:47:30 [vite] Internal server error: esbuild_1.startService is not a function
  Plugin: vite-plugin-mdx
  File: D:/Workspace/Web/Playground/vite-pages-demo/pages/$.mdx
      at D:\Workspace\Web\Playground\vite-pages-demo\node_modules\.pnpm\vite-plugin-mdx@2.0.1_react@17.0.2+vite@2.5.6\node_modules\vite-plugin-mdx\dist\transform.js:47:34
      at Generator.next (<anonymous>)
      at D:\Workspace\Web\Playground\vite-pages-demo\node_modules\.pnpm\vite-plugin-mdx@2.0.1_react@17.0.2+vite@2.5.6\node_modules\vite-plugin-mdx\dist\transform.js:8:71      at new Promise (<anonymous>)
      at __awaiter (D:\Workspace\Web\Playground\vite-pages-demo\node_modules\.pnpm\vite-plugin-mdx@2.0.1_react@17.0.2+vite@2.5.6\node_modules\vite-plugin-mdx\dist\transform.js:4:12)
      at ensureEsbuildService (D:\Workspace\Web\Playground\vite-pages-demo\node_modules\.pnpm\vite-plugin-mdx@2.0.1_react@17.0.2+vite@2.5.6\node_modules\vite-plugin-mdx\dist\transform.js:45:12)
      at Object.<anonymous> (D:\Workspace\Web\Playground\vite-pages-demo\node_modules\.pnpm\vite-plugin-mdx@2.0.1_react@17.0.2+vite@2.5.6\node_modules\vite-plugin-mdx\dist\transform.js:25:31)
      at Generator.next (<anonymous>)
      at fulfilled (D:\Workspace\Web\Playground\vite-pages-demo\node_modules\.pnpm\vite-plugin-mdx@2.0.1_react@17.0.2+vite@2.5.6\node_modules\vite-plugin-mdx\dist\transform.js:5:58)

It is fixed in the latest version. Could you try again?

On the machine that produces this issue, creating a new vite-pages project still gives me a package.json like this https://github.com/khalibloo/vite-pages-esbuild-bug/blob/master/package.json with vite-plugin-react-pages version 2.x.
Any ideas why running the npm init would give me the old version of the template? I believe the init command should always fetch the latest template, right?

I ran yarn create vite-pages app-demo --template app, which got the latest create-vite-pages. Then npm and pnpm just fixed themselves right after, and started fetching the latest version as well. I have no clue what caused the issue or why using yarn fixed npm and pnpm. It's also a bit concerning that npm init isn't guaranteed to fetch the latest versions of templates, but at least I'm unstuck for now. Thanks for your help!

It may be a bug of npm's cache. (By the way, are you using a custom npm regiatery?)
Try upgrading your npm version. Or delete npm cache.
This may be helpful: https://docs.npmjs.com/cli/v7/commands/npm-exec#a-note-on-caching

Nope, default configs for all 3 package managers. I suspected it might have been a cache issue with npm initially, given that i've used vite-pages on the machine with the issue a long time ago. But I just installed pnpm maybe 2 days ago. It didn't make sense that pnpm would also have the old create-vite-pages in its cache, unless it's somehow also using npm's cache behind the scenes. Oh and npm assured me that i shouldn't need to clean its cache when I tried to. So I quickly wrote that off.
Then I figured maybe it's the registry, and since yarn uses a different registry, that might work. And it did. Then I went back to npm to compare the outputs again and it also just worked. And so did pnpm. But I force-cleaned its cache anyway just for good measure.


SparseOracle refactor

[ ] Tests added for any new code
[ ] Ran make fmt-fix (or had formatting run automatically on all files edited)
[ ] Documentation added for any new functionality
[ ] Entries added to ./unreleased/ for any new functionality

Following the pattern laid out in #2709 for IntOracle, this PR introduces the same alterations to SparseOracle.
@konnov please take a look at chosenValueIsEqualToIndexedValue and getIndexOfChosenValueFromModel specifically. My understanding of the original design documentation (which is pretty sparse itself) is that the original method incorrectly references the indices on the Sparse- and original oracles in these methods.

Codecov Report

Merging #2744 (426f741) into main (e0a23e0) will decrease coverage by 0.03%.
The diff coverage is 57.14%.

@@            Coverage Diff             @@
##             main    #2744      +/-   ##
==========================================
- Coverage   78.88%   78.85%   -0.03%
==========================================
  Files         463      464       +1
  Lines       15866    15873       +7
  Branches     2568     2541      -27
==========================================
+ Hits        12516    12517       +1
- Misses       3350     3356       +6

Files Changed
Coverage Δ

...cmt/stratifiedRules/aux/oracles/SparseOracle.scala
57.14% <57.14%> (ø)

... and 3 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Update sensitive-information-type-entity-definitions.md

@chrfox Changes to existing DL and passport SITs which are going WW. https://o365exchange.visualstudio.com/IP Engineering/_workitems/edit/1676766

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks


Prevent overscroll on touch-based devices?

Whenever I use the website on an iOS device, whenever moving the mouse up or down, the screen overscrolls (scrolls above the usually allowed amount)
https://user-images.githubusercontent.com/16748384/103086446-90d60980-45dc-11eb-8959-ecfd9765d73b.mov
Is it possible to prevent this from happening?

There's probably some way to fix this, but I have no idea how. Contributions are welcome.

Would this work? https://stackoverflow.com/a/14130056

Your clip you put in just has a weird green flashing. is this part of the issue???

I don't see any green flashing on my end, no idea how you're seeing any.


Update developer guide

Fixes #25
Update developer guide with use cases for deletefriend and editfriend.

Codecov Report

Merging #28 (0b6feb4) into master (aacca7d) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #28   +/-   ##
=========================================
  Coverage     72.15%   72.15%
  Complexity      399      399
=========================================
  Files            70       70
  Lines          1232     1232
  Branches        125      125
=========================================
  Hits            889      889
  Misses          311      311
  Partials         32       32

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update aacca7d...0b6feb4. Read the comment docs.


Windows compatability updates

Also changed webpack.config.js to work with older versions of node

Coverage remained the same at 93.556% when pulling 0f58149c6f6a3df541f238d92fef985947f4d74e on orbweaver-:original into f6302fd70629d161a326f07489dad2ab2377a3e3 on Profiscience:master.

npm run scripts eliminate the need for global does, and you can pass additional args as such npm run test -- --browsers IE

The preferred method for this is going to be using bash on Windows. POSIX or bust.

I think if you run npm run XXX it goes back to the default windows CLI

Try using the WSL rather than git bash, or changing the run script to bash -c "..."

Coverage remained the same at 93.556% when pulling ba25eabda9dc5a8836fe6fd75f03c4c245c17c9c on orbweaver-:original into f6302fd70629d161a326f07489dad2ab2377a3e3 on Profiscience:master.

Coverage remained the same at 93.556% when pulling 7daae9f08c05b5ca86614815e068a3ab15a6ad71 on orbweaver-:original into f6302fd70629d161a326f07489dad2ab2377a3e3 on Profiscience:master.


Jasper won't accept commands

So I can start jasper and it asks how it may be of service. Sometimes right after it starts I am able to activate it and get it to do something like tell me what time it is. After that, or most times starting, it does not accept any commands and does not recognize the keyword "Jasper".
Here is the output. I am using the B+ image and followed the install instructions (couldn't get it running on Arch)
pi@raspberrypi ~ $ jasper/jasper.py
*******************************************************
*             JASPER - THE TALKING COMPUTER           *
* (c) 2015 Shubhro Saha, Charlie Marsh & Jan Holthuis *
*******************************************************
WARNING:root:tts_engine not specified in profile, defaulting to 'espeak-tts'
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2217:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
ALSA lib pcm_dmix.c:957:(snd_pcm_dmix_open) The dmix plugin supports only playba                                                                                ck stream
ALSA lib pcm_dmix.c:1018:(snd_pcm_dmix_open) unable to open slave
No disturbance detected
No disturbance detected
INFO:client.stt:Transcribed: ['']
ERROR:apscheduler.executors.default:Job "Notifier.gather (trigger: interval[0:00:30], next run at: 2016-08-23 03:01:50 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apscheduler/executors/base.py", line 108, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/home/pi/jasper/client/notifier.py", line 39, in gather
    [client.run() for client in self.notifiers]
  File "/home/pi/jasper/client/notifier.py", line 18, in run
    self.timestamp = self.gather(self.timestamp)
  File "/home/pi/jasper/client/notifier.py", line 43, in handleEmailNotifications
    emails = Gmail.fetchUnreadEmails(self.profile, since=lastDate)
  File "/home/pi/jasper/client/modules/Gmail.py", line 63, in fetchUnreadEmails
    conn.login(profile['gmail_address'], profile['gmail_password'])
  File "/usr/lib/python2.7/imaplib.py", line 505, in login
    typ, dat = self._simple_command('LOGIN', user, self._quote(password))
  File "/usr/lib/python2.7/imaplib.py", line 1062, in _quote
    arg = arg.replace('\\', '\\\\')
AttributeError: 'NoneType' object has no attribute 'replace'
No disturbance detected

Looks like your audio is not setup

So I had gotten one of the recommended microphones and it worked better. Still has problems with any appreciable distance (more than a foot from the microphone). I'm unsure if it is just not translating or what. I've made recordings using the mic at different distances and I can easily recognize my voice and commands across the room, but Jasper still has a hard time picking them up.

Yeah its likely a tuning/setup issue.  Please take it to the forums and close this, as it is not a code issue.


17 remove range address from config

And the range of address doesn't change in an experiment, so, we don't need to calculate it every time.

Maybe you can keep the field in the config, but overwrite it when initializing the config, with a function similar to the once in init_configs.

@leandernikolaus I think this one is ready to be merged. Please have a look.

Looks good!


Cannot find generate.sh file

it seems that file to generate template is not included to repository

Thanks. I will need to update the old file and then will push. In general, this script performs text search through the all of the project files and replaces placeholders into variable values.

By the way Tadai, are you able to build BusinessTemplate project? There were strange issue with JVFloatingLabel pod which should be solved by now.

interesting idea, but yeah there's no generate.sh file which presents some problems right now


sql/(plan,index): force index deletion on save failure

Fixes #233
It was either adding a force parameter or a new method that does this. Since the method had to be public I thought I might as well just add the force parameter.

Tests fixed, missed a couple usages of the function

Can we merge this?